-- Logs begin at Fri 2022-09-02 08:41:18 UTC, end at Fri 2022-09-02 09:49:52 UTC. -- Sep 02 09:11:47.777607 dv-cinder-850831-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 02 09:11:47.784940 dv-cinder-850831-3-smb devstack@keystone.service[81561]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 02 09:11:47.786899 dv-cinder-850831-3-smb devstack@keystone.service[81561]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 09:11:47 2022] *** Sep 02 09:11:47.786899 dv-cinder-850831-3-smb devstack@keystone.service[81561]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 09:11:47.786899 dv-cinder-850831-3-smb devstack@keystone.service[81561]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 09:11:47.786899 dv-cinder-850831-3-smb devstack@keystone.service[81561]: nodename: dv-cinder-850831-3-smb Sep 02 09:11:47.786899 dv-cinder-850831-3-smb devstack@keystone.service[81561]: machine: x86_64 Sep 02 09:11:47.786899 dv-cinder-850831-3-smb devstack@keystone.service[81561]: clock source: unix Sep 02 09:11:47.786899 dv-cinder-850831-3-smb devstack@keystone.service[81561]: pcre jit disabled Sep 02 09:11:47.787351 dv-cinder-850831-3-smb devstack@keystone.service[81561]: detected number of CPU cores: 4 Sep 02 09:11:47.787351 dv-cinder-850831-3-smb devstack@keystone.service[81561]: current working directory: / Sep 02 09:11:47.787351 dv-cinder-850831-3-smb devstack@keystone.service[81561]: detected binary path: /usr/bin/uwsgi-core Sep 02 09:11:47.787351 dv-cinder-850831-3-smb devstack@keystone.service[81561]: your processes number limit is 47680 Sep 02 09:11:47.787351 dv-cinder-850831-3-smb devstack@keystone.service[81561]: your memory page size is 4096 bytes Sep 02 09:11:47.787351 dv-cinder-850831-3-smb devstack@keystone.service[81561]: detected max file descriptor number: 2048 Sep 02 09:11:47.787351 dv-cinder-850831-3-smb devstack@keystone.service[81561]: lock engine: pthread robust mutexes Sep 02 09:11:47.787351 dv-cinder-850831-3-smb devstack@keystone.service[81561]: thunder lock: enabled Sep 02 09:11:47.787351 dv-cinder-850831-3-smb devstack@keystone.service[81561]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 02 09:11:47.787351 dv-cinder-850831-3-smb devstack@keystone.service[81561]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 09:11:47.826313 dv-cinder-850831-3-smb devstack@keystone.service[81561]: Python main interpreter initialized at 0x562b1f3369c0 Sep 02 09:11:47.826313 dv-cinder-850831-3-smb devstack@keystone.service[81561]: python threads support enabled Sep 02 09:11:47.826313 dv-cinder-850831-3-smb devstack@keystone.service[81561]: your server socket listen backlog is limited to 100 connections Sep 02 09:11:47.826313 dv-cinder-850831-3-smb devstack@keystone.service[81561]: your mercy for graceful operations on workers is 90 seconds Sep 02 09:11:47.830540 dv-cinder-850831-3-smb devstack@keystone.service[81561]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 09:11:47.830540 dv-cinder-850831-3-smb devstack@keystone.service[81561]: *** Operational MODE: preforking *** Sep 02 09:11:47.830540 dv-cinder-850831-3-smb devstack@keystone.service[81561]: *** uWSGI is running in multiple interpreter mode *** Sep 02 09:11:47.830540 dv-cinder-850831-3-smb devstack@keystone.service[81561]: spawned uWSGI master process (pid: 81561) Sep 02 09:11:47.830540 dv-cinder-850831-3-smb devstack@keystone.service[81561]: spawned uWSGI worker 1 (pid: 81572, cores: 1) Sep 02 09:11:47.830540 dv-cinder-850831-3-smb devstack@keystone.service[81561]: spawned uWSGI worker 2 (pid: 81573, cores: 1) Sep 02 09:11:47.830540 dv-cinder-850831-3-smb devstack@keystone.service[81561]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 09:11:47.827227 dv-cinder-850831-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 02 09:11:52.099713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:11:52.099713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: from cryptography.utils import int_from_bytes Sep 02 09:11:52.100495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:11:52.100495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: from cryptography.utils import int_from_bytes Sep 02 09:11:52.104303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:11:52.104303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: from cryptography.utils import int_from_bytes Sep 02 09:11:52.104771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:11:52.104771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: from cryptography.utils import int_from_bytes Sep 02 09:11:52.150742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 09:11:52.154645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 09:11:52.154645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] command line args: [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 09:11:52.154645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 09:11:52.154645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ================================================================================ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 09:11:52.154942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 09:11:52.155007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] admin_token = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.155066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 09:11:52.155124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config_dir = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.155192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] command line args: [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 09:11:52.155257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.155339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 09:11:52.155408 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config_source = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.155467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ================================================================================ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 09:11:52.155529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] debug = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.155529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.155999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] admin_token = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.155999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] config_dir = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] config_source = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156375 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] debug = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_config_append = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.156981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_dir = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_config_append = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_dir = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.157924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158665 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.158994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159528 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] publish_errors = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] publish_errors = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.159978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] standard_threads = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160676 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] standard_threads = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_journal = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_json = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.160983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.161045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_stderr = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.161745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.161921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_syslog = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.162031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] use_journal = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.162129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.162235 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] use_json = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.162235 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] use_stderr = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.162417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.162490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] use_syslog = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.162615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.162700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:11:52.162771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.162894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.162969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.163164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.163242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.163358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.163431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.163546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.163619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.163742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.163818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.163959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.164087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.164162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.164231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.164353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.164435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.164511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.164582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.164650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.165218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.165298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.165370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.165439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.165508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.165622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.165704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.165856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.165946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.166140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.166261 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.166366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.166452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.166609 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.166686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.166843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.166920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.167097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.167171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.167360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.167440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.167579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.167655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.167827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.167954 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.168084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.168167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.168315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.168395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.168545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.168620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.168767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.168838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.169008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.169087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.169236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.169310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.169467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.169541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.169695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.169775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.169981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.170121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.170189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.170252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.170419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.170510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.170662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.170744 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.170895 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.170968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.171130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.171205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.171362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.171449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.171589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.171669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.171815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.171930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.172068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.172156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.172294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.172368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.172523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.172599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.172752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.172840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.172977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.173052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.173210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.173312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.173440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.173553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.173656 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.173754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.173890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.174116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.174196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.174321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.174404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.174481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.174560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.174676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.174794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.174864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.175006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.175090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.175239 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.175343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.175470 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.175544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.175694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.175768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.175945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.176023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.176180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.176294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.177552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.177666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.177666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.177804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.177804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.177980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178870 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.178938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179129 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179277 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.179985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.180052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.180246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.180393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.181896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.182024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.182099 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.182191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.182334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.182409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.182569 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.182651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.182828 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.182903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.183065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.183140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.183345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.183499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.187369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.187519 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.187648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.187777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.187921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.188061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.188189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.188314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.188450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.188576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.188705 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.188838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.188963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.189087 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.189211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.189335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.189461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.189594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.189724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.189848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.189971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.190096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.190230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.190362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.190486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.190616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.190740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.190871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.191000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.191132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.191258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.191381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.191504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.191628 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.191757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.191982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.192118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.external = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.192265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.192398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.192523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.192523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.external = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.192766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.192892 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.193024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.193154 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.193281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.password = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.193411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.193535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.token = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.193667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.password = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.193807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.193932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.token = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.194056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.194180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.194305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.194437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.194562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.194686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.194811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.194935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.195059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.195190 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.195316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.195448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.195584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.195709 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.195834 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.195978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.196109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.196240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.196365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.196490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.196621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.196752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.196883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.197008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.197132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.197265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.197396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.197529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.197660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.197784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.197909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.198034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.198158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.198294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.198478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.198556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.198633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.198704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.198773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.198916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.198991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199197 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199621 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.199844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.200473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.200585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.200662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.200731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.200857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.200933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201284 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201919 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.201988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202394 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202547 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202693 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.202974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.203981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.204985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205277 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205840 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.205950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206378 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.206943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207154 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207375 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.207937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208922 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.208993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.209062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.209137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.209208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.209277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.209346 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.209507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.209585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.209738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.209823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.209981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.210057 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.210225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.210308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.210470 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.210545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.210701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.210775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.210930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.211015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.211161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.211239 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.211391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.211466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.211645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.211731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.211936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.212019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.212187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.212265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.212358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.212449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.212603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.212680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.212845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.212920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.213086 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.213170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.213313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.213388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.213545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.213620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.213779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.213862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.214012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.214151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.214246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.214321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.214476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.214559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.214708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.214785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.214950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.215025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.215187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.215271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.215418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.215493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.215681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.215760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.215958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.216118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.216193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.216262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.216429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.216505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.216663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.216746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.216899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.216974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.217144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.217220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.217372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.217455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.217601 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.217676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.217837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.217911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.218072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.218154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.218318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.218400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.218550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.218625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.218780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.218862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.219029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.219105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.219259 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.219333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.219496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.219578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.219735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.219813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.219988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.220067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.220221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.220308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.220453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] role.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.220529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.220685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.220759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] role.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.220915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.220998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.221165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.221241 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.221407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.221483 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.221651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.221734 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.221893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.221969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.222137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.222261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.222381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.222537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.222613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.222756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.222856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.222990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.223074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.223237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.223313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.223483 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.223560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.223729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.223812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.223998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.224078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.224401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.224478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.224636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.224728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.224882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.224958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.225128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.225204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.225373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.225456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.225617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.225692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.225847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.225922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.226097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.226180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.226345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.226420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.226580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.226655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.226809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.226892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.227763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.227837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.227837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.227986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.228056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.228139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.228276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.228380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.228521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.228629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.228757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.228864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.228989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.229098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.229220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.229330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.229455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.229563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.229692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.229799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.229937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.230046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.230170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.230281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.230423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.230535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.230667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.230782 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.230901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.231017 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.231143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.231258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.231382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.231498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.231632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.231743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.231866 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.232001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.232126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.232238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.232359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.232471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.232601 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.232717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.232881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.233020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.233192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.233300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.233400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.233473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.233582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.233731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.233838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.233989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.234065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.234230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.234307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.234476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.234551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.234712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.234794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.234953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.235030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.235187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.235263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.235417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.235492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.235633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.235707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.235877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.235981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.236131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.236206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.236365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.236441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.236857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.236984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.237094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.237169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.237324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.237400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.237560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.237635 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.237786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.237861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.238019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.238095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.238248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.238323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.238415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 09:11:52.238490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:11:52.238633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 09:11:52.268207 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.268435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.268617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.268699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.268848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.269070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.276970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.277604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.309316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.309451 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.309531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.309645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.361980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.362662 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.415781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.416058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.416508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.416737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.571900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.572129 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.572345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.572563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.572779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.572994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.577798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.578031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.578255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.578475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.578690 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.578902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.596337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.596438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.596566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.596647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.596790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.596869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.597011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.597092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.597230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.597310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.597445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.597533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.597658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.597736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.609417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.609513 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.622113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.622309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.622511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.622644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.622725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.622875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.623018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.623098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.623169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.623318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.623475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.623572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.623732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.623975 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 09:11:52.646093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.646307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 09:11:52.646607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.646691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.646817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 09:11:52.646899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 09:11:52.647160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.647365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.647451 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 09:11:52.647641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.647724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.647916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.648007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.648180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.648262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.648438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.658136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.658415 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.658546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.661306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.661382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.661443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.661502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.661502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.666622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.666977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.669601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.669889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.669970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.670171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.670251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.670451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.670531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.670731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.670810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.670990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.671070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.671256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.671334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.671526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.671637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.671799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.671929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.672100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.672208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.672381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.672462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.672649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.695318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.695417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.696892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.696998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.697178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.697258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.701843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.701932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.702124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.702205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.702403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.702483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.708824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.708935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.709112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.709194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.713777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.714068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.714353 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.716418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.716418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.716418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.716585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.716656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.716725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.716787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.716846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.716846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.716846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.716846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.717049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.717200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.733276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.733520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.733604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.733801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.737619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.737946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.740834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.741126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.741328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.741627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.745339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.745876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.748442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.749158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.751642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.751974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.752260 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.752514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.752609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.752810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.752890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.753092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.753173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.753373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.753660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.753939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.768916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.769203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.769469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.769731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.770005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.770397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.770671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.770936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.777178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.778543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.778707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.780119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.780280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.780560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.781669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.781946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.783203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.783497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.783779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.784084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.784488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.784626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.784933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.785301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.785588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.785878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.796308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.796589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.796868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.797150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.797529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.797810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.798087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.798169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.798373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.798754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.799040 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.799325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.799605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.799915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.813663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.815737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.816627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.818685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.819526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.821033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.821750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.822517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.822802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.823200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.823288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.824836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.825123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.825427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.829735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.833326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.833425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.833425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.834125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.834520 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.834809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.835094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.836506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.837323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.837610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.837893 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.843483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.843777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.844088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.845815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.846108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.846390 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.851071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.851356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.851637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.851938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.852276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.853038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.853322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.853602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.853882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.853963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 09:11:52.854163 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.854242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.854433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.854520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.854696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.854774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.854960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.855041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.855234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.855314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.855543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.855828 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.856130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.856406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.856714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.856944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.857203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.857469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 09:11:52.891157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562b1f3369c0 pid: 81572 (default app) Sep 02 09:11:52.892553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562b1f3369c0 pid: 81573 (default app) Sep 02 09:11:52.894407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9240f7-2273-4ba2-89fa-59293d277840 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:11:52.894696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9240f7-2273-4ba2-89fa-59293d277840 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:11:52.894968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9240f7-2273-4ba2-89fa-59293d277840 None None] PATH_INFO: `/v3` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:11:52.899159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Fri Sep 2 09:11:52 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:00.528644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea498e-eb87-4703-983f-66ad224e21f6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:00.529170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea498e-eb87-4703-983f-66ad224e21f6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:00.529170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea498e-eb87-4703-983f-66ad224e21f6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:00.533416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:00.538499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:00.538981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:00.539081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:00.608743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: INFO dbcounter [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] Registered counter for database keystone Sep 02 09:12:00.628239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG oslo_db.sqlalchemy.engines [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:12:00.634384 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writer thread running {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:12:00.812406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG passlib.handlers.bcrypt [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81572) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 02 09:12:00.812720 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG passlib.handlers.bcrypt [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81572) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 02 09:12:00.871275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:00.872896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:01.001416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 02 09:12:01.485577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea498e-eb87-4703-983f-66ad224e21f6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:01.555151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: INFO dbcounter [None req-88ea498e-eb87-4703-983f-66ad224e21f6 None None] Registered counter for database keystone Sep 02 09:12:01.577155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG oslo_db.sqlalchemy.engines [None req-88ea498e-eb87-4703-983f-66ad224e21f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:12:01.583452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writer thread running {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:12:01.701979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea498e-eb87-4703-983f-66ad224e21f6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:01.706279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4668366-ff5b-4f55-a7a1-7d2f43810fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:01.706906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668366-ff5b-4f55-a7a1-7d2f43810fff admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:01.707244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668366-ff5b-4f55-a7a1-7d2f43810fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:01.707530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668366-ff5b-4f55-a7a1-7d2f43810fff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:01.715572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4668366-ff5b-4f55-a7a1-7d2f43810fff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:01.767307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e4668366-ff5b-4f55-a7a1-7d2f43810fff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 02 09:12:01.767593 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4668366-ff5b-4f55-a7a1-7d2f43810fff admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:01.776901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1324 bytes} [Fri Sep 2 09:12:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:12:01.782799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:01.797014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e517c-922c-4481-81d6-733c9a0de0d5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:01.801476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23060be2-26ec-4c93-bfce-c6476f0a8a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:01.802601 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23060be2-26ec-4c93-bfce-c6476f0a8a16 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:01.802885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23060be2-26ec-4c93-bfce-c6476f0a8a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:01.803160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23060be2-26ec-4c93-bfce-c6476f0a8a16 admin admin] PATH_INFO: `/v3/projects/736e52eb4dfe4b01a672224315f6274a` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:01.804752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23060be2-26ec-4c93-bfce-c6476f0a8a16 admin admin] RBAC: Authorizing `identity:get_project(project_id=736e52eb4dfe4b01a672224315f6274a)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:01.858393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: WARNING keystone.common.rbac_enforcer.enforcer [None req-23060be2-26ec-4c93-bfce-c6476f0a8a16 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 02 09:12:01.858745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23060be2-26ec-4c93-bfce-c6476f0a8a16 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:01.863604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 3/5] 10.222.0.55 () {56 vars in 1207 bytes} [Fri Sep 2 09:12:01 2022] GET /identity/v3/projects/736e52eb4dfe4b01a672224315f6274a => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:03.702983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfab47-d6ec-4d0f-9595-c8260eaf4a6a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:03.703534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfab47-d6ec-4d0f-9595-c8260eaf4a6a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:03.703534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfab47-d6ec-4d0f-9595-c8260eaf4a6a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:03.707646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 3/6] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:12:03.713509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c2be1-52ee-4bb0-9b23-9a9b7022fcf4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:03.713881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c2be1-52ee-4bb0-9b23-9a9b7022fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:03.714042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c2be1-52ee-4bb0-9b23-9a9b7022fcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:03.734719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a86c2be1-52ee-4bb0-9b23-9a9b7022fcf4 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:03.736226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a86c2be1-52ee-4bb0-9b23-9a9b7022fcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:03.744169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 02 09:12:04.007536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfab47-d6ec-4d0f-9595-c8260eaf4a6a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:04.020102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfab47-d6ec-4d0f-9595-c8260eaf4a6a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:04.024275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3b07c-00ad-454b-8865-fc726540caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:04.024866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b07c-00ad-454b-8865-fc726540caf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:04.025141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b07c-00ad-454b-8865-fc726540caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:04.025412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b07c-00ad-454b-8865-fc726540caf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:04.032876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3b07c-00ad-454b-8865-fc726540caf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:04.034643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3b07c-00ad-454b-8865-fc726540caf9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:04.043122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1324 bytes} [Fri Sep 2 09:12:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:12:04.048203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c2be1-52ee-4bb0-9b23-9a9b7022fcf4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:04.057571 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c2be1-52ee-4bb0-9b23-9a9b7022fcf4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:04.061898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bba8f-efe9-46d0-83b5-c602e80688cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:04.062514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bba8f-efe9-46d0-83b5-c602e80688cd admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:04.062788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bba8f-efe9-46d0-83b5-c602e80688cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:04.063056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bba8f-efe9-46d0-83b5-c602e80688cd admin admin] PATH_INFO: `/v3/users/5721b6199cb646449381111a06a1e879` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:04.064380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bba8f-efe9-46d0-83b5-c602e80688cd admin admin] RBAC: Authorizing `identity:get_user(user_id=5721b6199cb646449381111a06a1e879)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:04.066185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bba8f-efe9-46d0-83b5-c602e80688cd admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:04.067668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 5/9] 10.222.0.55 () {56 vars in 1198 bytes} [Fri Sep 2 09:12:04 2022] GET /identity/v3/users/5721b6199cb646449381111a06a1e879 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:06.005702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f11a-3dff-46d3-b3d6-04edbd93795c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:06.006242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f11a-3dff-46d3-b3d6-04edbd93795c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:06.006359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f11a-3dff-46d3-b3d6-04edbd93795c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:06.007694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:06.012824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811c895-dce9-4ccc-89f4-e84182f4f67f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:06.013228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811c895-dce9-4ccc-89f4-e84182f4f67f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:06.013363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811c895-dce9-4ccc-89f4-e84182f4f67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:06.031353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4811c895-dce9-4ccc-89f4-e84182f4f67f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:06.032526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4811c895-dce9-4ccc-89f4-e84182f4f67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:06.053698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c982d3-0d4c-4971-94e4-03c71bead425 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:06.054101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c982d3-0d4c-4971-94e4-03c71bead425 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:06.054379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c982d3-0d4c-4971-94e4-03c71bead425 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:06.055692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 6/11] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:12:06.060695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cc2b8-a421-4a81-8546-d51134ae8a17 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:06.060980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cc2b8-a421-4a81-8546-d51134ae8a17 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:06.061257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cc2b8-a421-4a81-8546-d51134ae8a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:06.103234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG passlib.handlers.bcrypt [None req-7e8cc2b8-a421-4a81-8546-d51134ae8a17 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81573) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 02 09:12:06.103550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG passlib.handlers.bcrypt [None req-7e8cc2b8-a421-4a81-8546-d51134ae8a17 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81573) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 02 09:12:06.111618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:06.152478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7e8cc2b8-a421-4a81-8546-d51134ae8a17 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:06.154049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7e8cc2b8-a421-4a81-8546-d51134ae8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:06.251999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:06.389491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811c895-dce9-4ccc-89f4-e84182f4f67f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:06.400202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:06.478972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811c895-dce9-4ccc-89f4-e84182f4f67f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:06.514297 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6419fd-7671-4bc1-8527-17b182a4bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:06.514934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6419fd-7671-4bc1-8527-17b182a4bd20 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:06.515213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6419fd-7671-4bc1-8527-17b182a4bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:06.515487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6419fd-7671-4bc1-8527-17b182a4bd20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:06.517476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cc2b8-a421-4a81-8546-d51134ae8a17 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:06.527370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6419fd-7671-4bc1-8527-17b182a4bd20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-fe6419fd-7671-4bc1-8527-17b182a4bd20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:06.536347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:06.538484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 7/14] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:12:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:06.545111 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6419fd-7671-4bc1-8527-17b182a4bd20 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:06.620034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cc2b8-a421-4a81-8546-d51134ae8a17 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:06.622294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:06.626072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:06.644237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6419fd-7671-4bc1-8527-17b182a4bd20 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:06.657077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c0d0-184b-498c-b870-2aae7f6e2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:06.658007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c0d0-184b-498c-b870-2aae7f6e2dbb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:06.658290 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c0d0-184b-498c-b870-2aae7f6e2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:06.658560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c0d0-184b-498c-b870-2aae7f6e2dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:06.679064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29944e-39fc-46cd-85f3-60ce05cd71c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:06.679659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29944e-39fc-46cd-85f3-60ce05cd71c7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:06.679973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29944e-39fc-46cd-85f3-60ce05cd71c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:06.680245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29944e-39fc-46cd-85f3-60ce05cd71c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:06.680928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29944e-39fc-46cd-85f3-60ce05cd71c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:06.681227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29944e-39fc-46cd-85f3-60ce05cd71c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:06.682630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29944e-39fc-46cd-85f3-60ce05cd71c7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:06.694013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 8/15] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:06.700110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29944e-39fc-46cd-85f3-60ce05cd71c7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:06.724207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4c0d0-184b-498c-b870-2aae7f6e2dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:06.726912 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4c0d0-184b-498c-b870-2aae7f6e2dbb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:06.796864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29944e-39fc-46cd-85f3-60ce05cd71c7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:06.827341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 09:12:06.831962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49a173-277a-4075-a9f2-25555bb64005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:06.832600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49a173-277a-4075-a9f2-25555bb64005 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:06.832707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c0d0-184b-498c-b870-2aae7f6e2dbb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:06.832879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49a173-277a-4075-a9f2-25555bb64005 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:06.833153 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49a173-277a-4075-a9f2-25555bb64005 None admin] PATH_INFO: `/v3/users/5721b6199cb646449381111a06a1e879` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:06.834296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49a173-277a-4075-a9f2-25555bb64005 None admin] RBAC: Authorizing `identity:get_user(user_id=5721b6199cb646449381111a06a1e879)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:06.835774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49a173-277a-4075-a9f2-25555bb64005 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:06.836997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:06.837419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 9/17] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:06 2022] GET /identity/v3/users/5721b6199cb646449381111a06a1e879 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:06.842755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49a173-277a-4075-a9f2-25555bb64005 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:06.857001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:06.932498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c0d0-184b-498c-b870-2aae7f6e2dbb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:06.939557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49a173-277a-4075-a9f2-25555bb64005 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:06.965173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0a394-d56f-46fe-803b-e661b16cab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:06.966017 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a394-d56f-46fe-803b-e661b16cab84 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:06.966291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a394-d56f-46fe-803b-e661b16cab84 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:06.966563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a394-d56f-46fe-803b-e661b16cab84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:06.974001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1c38-ccac-4370-bbb1-7025cca735dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:06.974631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1c38-ccac-4370-bbb1-7025cca735dc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:06.974909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1c38-ccac-4370-bbb1-7025cca735dc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:06.975181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1c38-ccac-4370-bbb1-7025cca735dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:06.976327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf1c38-ccac-4370-bbb1-7025cca735dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:06.977820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf1c38-ccac-4370-bbb1-7025cca735dc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:06.979362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 10/18] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:06.984357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0a394-d56f-46fe-803b-e661b16cab84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:06.985166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1c38-ccac-4370-bbb1-7025cca735dc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:06.985770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0a394-d56f-46fe-803b-e661b16cab84 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-dea0a394-d56f-46fe-803b-e661b16cab84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:12:07.006565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:07.007921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:12:07.009317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:12:07.009317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:12:07.009317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:07.009317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 9/19] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:12:07.013941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0a394-d56f-46fe-803b-e661b16cab84 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:07.067289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:07.067937 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:07.086088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1c38-ccac-4370-bbb1-7025cca735dc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:07.111558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0a394-d56f-46fe-803b-e661b16cab84 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:07.120299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba5e8-68a1-48c2-87ca-356b93e6d68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:07.120908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba5e8-68a1-48c2-87ca-356b93e6d68a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:07.121245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba5e8-68a1-48c2-87ca-356b93e6d68a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:07.121518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba5e8-68a1-48c2-87ca-356b93e6d68a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:07.122244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fba5e8-68a1-48c2-87ca-356b93e6d68a None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.domain.id=default, user.id=5721b6199cb646449381111a06a1e879) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:07.122548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fba5e8-68a1-48c2-87ca-356b93e6d68a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:07.124016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fba5e8-68a1-48c2-87ca-356b93e6d68a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:07.130649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1322 bytes} [Fri Sep 2 09:12:06 2022] GET /identity/v3/role_assignments?user.id=5721b6199cb646449381111a06a1e879&scope.domain.id=default&role.id=04d1bc62091440e189989e4b973a6627 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:07.145524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca2d10-9963-471a-97ae-fbdaeb104576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:07.146157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2d10-9963-471a-97ae-fbdaeb104576 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:07.146435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2d10-9963-471a-97ae-fbdaeb104576 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:07.146702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2d10-9963-471a-97ae-fbdaeb104576 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:07.147356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca2d10-9963-471a-97ae-fbdaeb104576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:07.147658 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca2d10-9963-471a-97ae-fbdaeb104576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:07.149788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca2d10-9963-471a-97ae-fbdaeb104576 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:07.169083 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:09.179432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f6d6-055d-4b68-9599-1a1cdbe8ff6d None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:09.180902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f6d6-055d-4b68-9599-1a1cdbe8ff6d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:09.181352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f6d6-055d-4b68-9599-1a1cdbe8ff6d None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:09.182850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:09.188193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c711c-715b-4a02-a71e-376d0a40c520 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:09.188967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c711c-715b-4a02-a71e-376d0a40c520 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:09.189412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c711c-715b-4a02-a71e-376d0a40c520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:09.213335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f37c711c-715b-4a02-a71e-376d0a40c520 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:09.214793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f37c711c-715b-4a02-a71e-376d0a40c520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:09.300169 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 11/23] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:09.428520 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecddae6-c014-4b17-8827-a6cc5b2000f4 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:09.429103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecddae6-c014-4b17-8827-a6cc5b2000f4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:09.429613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecddae6-c014-4b17-8827-a6cc5b2000f4 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:09.431670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:09.446330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d833-791d-4b93-a4c9-339bcffab832 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:09.446861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d833-791d-4b93-a4c9-339bcffab832 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:09.447358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d833-791d-4b93-a4c9-339bcffab832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:09.466879 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-efc3d833-791d-4b93-a4c9-339bcffab832 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:09.468079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-efc3d833-791d-4b93-a4c9-339bcffab832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:09.530344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:09.567735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 12/25] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:09.680425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecddae6-c014-4b17-8827-a6cc5b2000f4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:09.812321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecddae6-c014-4b17-8827-a6cc5b2000f4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:09.849570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a70a2-e76b-48c2-8e4f-e6ccfeb2e062 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:09.850121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a70a2-e76b-48c2-8e4f-e6ccfeb2e062 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:09.850612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a70a2-e76b-48c2-8e4f-e6ccfeb2e062 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:09.852320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 13/26] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:09.858312 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18fab-bb6e-4afc-92ba-09c0d1b2778f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:09.858832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18fab-bb6e-4afc-92ba-09c0d1b2778f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:09.859053 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021d7b5-99cc-437d-9557-6619945b040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:09.859536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18fab-bb6e-4afc-92ba-09c0d1b2778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:09.859728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021d7b5-99cc-437d-9557-6619945b040e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:09.859986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021d7b5-99cc-437d-9557-6619945b040e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:09.860262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021d7b5-99cc-437d-9557-6619945b040e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:09.880512 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021d7b5-99cc-437d-9557-6619945b040e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1021d7b5-99cc-437d-9557-6619945b040e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:09.887008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:09.887839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:09.888616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 14/27] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:12:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:09.896767 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021d7b5-99cc-437d-9557-6619945b040e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:09.904105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-89f18fab-bb6e-4afc-92ba-09c0d1b2778f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:09.905540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-89f18fab-bb6e-4afc-92ba-09c0d1b2778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:09.937214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:10.060453 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 14/28] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:10.061868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7013a-2bfb-42a3-8453-58a00e9c5db5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:10.062156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7013a-2bfb-42a3-8453-58a00e9c5db5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:10.062429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7013a-2bfb-42a3-8453-58a00e9c5db5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:10.063184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021d7b5-99cc-437d-9557-6619945b040e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:10.063659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 15/29] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:10.068237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7013a-2bfb-42a3-8453-58a00e9c5db5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:10.112022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0a71b-147c-45f8-8f5e-ec7551d2f163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:10.112974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a71b-147c-45f8-8f5e-ec7551d2f163 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:10.113257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a71b-147c-45f8-8f5e-ec7551d2f163 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:10.113530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a71b-147c-45f8-8f5e-ec7551d2f163 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:10.114195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0a71b-147c-45f8-8f5e-ec7551d2f163 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:10.114496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0a71b-147c-45f8-8f5e-ec7551d2f163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:10.116459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0a71b-147c-45f8-8f5e-ec7551d2f163 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:10.127178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 15/30] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:10.129356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcfa95-0df4-4170-bf5f-f2ea63b84df7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:10.129637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcfa95-0df4-4170-bf5f-f2ea63b84df7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:10.129909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcfa95-0df4-4170-bf5f-f2ea63b84df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:10.165227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-86dcfa95-0df4-4170-bf5f-f2ea63b84df7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:10.166403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-86dcfa95-0df4-4170-bf5f-f2ea63b84df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:10.217624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7013a-2bfb-42a3-8453-58a00e9c5db5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:10.240441 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:10.275493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df3a58-9b99-4789-83de-4c422102060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:10.279191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df3a58-9b99-4789-83de-4c422102060d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:10.279480 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df3a58-9b99-4789-83de-4c422102060d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:10.279756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df3a58-9b99-4789-83de-4c422102060d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:10.292217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:10.299163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df3a58-9b99-4789-83de-4c422102060d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:10.303899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 16/31] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:10.313343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcfa95-0df4-4170-bf5f-f2ea63b84df7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:10.313446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df3a58-9b99-4789-83de-4c422102060d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-26df3a58-9b99-4789-83de-4c422102060d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:12:10.333187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:10.334080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:12:10.334860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:12:10.334860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:12:10.334860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:10.336334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 16/32] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:10.344933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df3a58-9b99-4789-83de-4c422102060d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:10.494669 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcfa95-0df4-4170-bf5f-f2ea63b84df7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:10.503608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df3a58-9b99-4789-83de-4c422102060d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:10.542752 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b441b-e69a-4952-b051-ab4f27c21cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:10.543952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b441b-e69a-4952-b051-ab4f27c21cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:10.544441 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b441b-e69a-4952-b051-ab4f27c21cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:10.545076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b441b-e69a-4952-b051-ab4f27c21cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:10.545914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b441b-e69a-4952-b051-ab4f27c21cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:10.546414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b441b-e69a-4952-b051-ab4f27c21cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:10.548088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b441b-e69a-4952-b051-ab4f27c21cf8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:10.562515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 17/33] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:10.566040 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b441b-e69a-4952-b051-ab4f27c21cf8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:10.584214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ca3c-e76c-42f9-b44e-b3c5f9376e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:10.585809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ca3c-e76c-42f9-b44e-b3c5f9376e25 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:10.587667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ca3c-e76c-42f9-b44e-b3c5f9376e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:10.588172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ca3c-e76c-42f9-b44e-b3c5f9376e25 None admin] PATH_INFO: `/v3/users/5721b6199cb646449381111a06a1e879` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:10.589528 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47ca3c-e76c-42f9-b44e-b3c5f9376e25 None admin] RBAC: Authorizing `identity:get_user(user_id=5721b6199cb646449381111a06a1e879)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:10.593167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47ca3c-e76c-42f9-b44e-b3c5f9376e25 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:10.597721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 17/34] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:10 2022] GET /identity/v3/users/5721b6199cb646449381111a06a1e879 => generated 247 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:10.598702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ca3c-e76c-42f9-b44e-b3c5f9376e25 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:10.603038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:10.666608 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:10.698699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b441b-e69a-4952-b051-ab4f27c21cf8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:10.705587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ca3c-e76c-42f9-b44e-b3c5f9376e25 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:10.737502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d65a0b-a794-4bbe-becd-6c435fe5ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:10.739811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d65a0b-a794-4bbe-becd-6c435fe5ba71 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:10.740304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d65a0b-a794-4bbe-becd-6c435fe5ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:10.740797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d65a0b-a794-4bbe-becd-6c435fe5ba71 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:10.741644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d65a0b-a794-4bbe-becd-6c435fe5ba71 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:10.741760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f8272-cf95-4b81-86a2-3c6dd06fde56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:10.742319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8272-cf95-4b81-86a2-3c6dd06fde56 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:10.742599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8272-cf95-4b81-86a2-3c6dd06fde56 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:10.743388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8272-cf95-4b81-86a2-3c6dd06fde56 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:10.744060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f8272-cf95-4b81-86a2-3c6dd06fde56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:10.744983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d65a0b-a794-4bbe-becd-6c435fe5ba71 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:10.745619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f8272-cf95-4b81-86a2-3c6dd06fde56 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:10.938622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 18/35] 10.222.0.55 () {60 vars in 1131 bytes} [Fri Sep 2 09:12:10 2022] POST /identity/v3/roles => generated 219 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:10.939892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d65a0b-a794-4bbe-becd-6c435fe5ba71 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:10.996927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 18/36] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:12:10 2022] POST /identity/v3/projects => generated 301 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:10.998411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f8272-cf95-4b81-86a2-3c6dd06fde56 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:11.036581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:11.064905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d65a0b-a794-4bbe-becd-6c435fe5ba71 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:11.116547 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ee047-c854-4a03-b164-6a971074fdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:11.117240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee047-c854-4a03-b164-6a971074fdf0 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:11.117526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee047-c854-4a03-b164-6a971074fdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:11.117803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee047-c854-4a03-b164-6a971074fdf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:11.119103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ee047-c854-4a03-b164-6a971074fdf0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:11.120789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ee047-c854-4a03-b164-6a971074fdf0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:11.189860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f8272-cf95-4b81-86a2-3c6dd06fde56 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:11.194022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 19/37] 10.222.0.55 () {60 vars in 1131 bytes} [Fri Sep 2 09:12:10 2022] POST /identity/v3/roles => generated 225 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:11.195365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6303c-3af8-4857-b6de-8f1c6e55e300 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:11.195673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6303c-3af8-4857-b6de-8f1c6e55e300 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:11.196160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6303c-3af8-4857-b6de-8f1c6e55e300 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:11.197358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 20/38] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:11.198520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0ee2-e845-40f8-9d55-a99e97d4a8ba None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:11.198769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0ee2-e845-40f8-9d55-a99e97d4a8ba None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:11.199048 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0ee2-e845-40f8-9d55-a99e97d4a8ba None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:11.207942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 21/39] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:11.207942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72cc6-b981-4242-a265-adf72c46548d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:11.207942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72cc6-b981-4242-a265-adf72c46548d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:11.207942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72cc6-b981-4242-a265-adf72c46548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:11.219062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:11.228541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0bc72cc6-b981-4242-a265-adf72c46548d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:11.230877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0bc72cc6-b981-4242-a265-adf72c46548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:11.247293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97556f-5301-42cd-8d9d-fdb4715c803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:11.249923 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97556f-5301-42cd-8d9d-fdb4715c803a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:11.250081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97556f-5301-42cd-8d9d-fdb4715c803a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:11.250450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97556f-5301-42cd-8d9d-fdb4715c803a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:11.252001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97556f-5301-42cd-8d9d-fdb4715c803a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:11.253791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97556f-5301-42cd-8d9d-fdb4715c803a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:11.259970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 19/40] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:11.259970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ba6a1-a8d5-4d3e-8457-118c900e3a9d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:11.259970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ba6a1-a8d5-4d3e-8457-118c900e3a9d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:11.259970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ba6a1-a8d5-4d3e-8457-118c900e3a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:11.281952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-9f8ba6a1-a8d5-4d3e-8457-118c900e3a9d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:11.283871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9f8ba6a1-a8d5-4d3e-8457-118c900e3a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:11.342587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 22/41] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:11.348987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc72cc6-b981-4242-a265-adf72c46548d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:11.404484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 20/42] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:11.437406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:11.478705 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc72cc6-b981-4242-a265-adf72c46548d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:11.522978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a1168-ecea-4777-88e5-82a853e6cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:11.522978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a1168-ecea-4777-88e5-82a853e6cefd None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:11.523206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a1168-ecea-4777-88e5-82a853e6cefd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:11.523480 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a1168-ecea-4777-88e5-82a853e6cefd None admin] PATH_INFO: `/v3/domains/default/users/5721b6199cb646449381111a06a1e879/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:11.525749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a1168-ecea-4777-88e5-82a853e6cefd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5721b6199cb646449381111a06a1e879, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:11.527208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a1168-ecea-4777-88e5-82a853e6cefd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:11.631579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 23/43] 10.222.0.55 () {58 vars in 1361 bytes} [Fri Sep 2 09:12:11 2022] PUT /identity/v3/domains/default/users/5721b6199cb646449381111a06a1e879/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:12:11.637044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ba6a1-a8d5-4d3e-8457-118c900e3a9d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:11.687412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a1168-ecea-4777-88e5-82a853e6cefd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:11.760161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ba6a1-a8d5-4d3e-8457-118c900e3a9d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:11.780296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:11.801874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a72a4f-4931-457e-8029-c012acc428d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:11.802527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72a4f-4931-457e-8029-c012acc428d5 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:11.802809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72a4f-4931-457e-8029-c012acc428d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:11.803083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72a4f-4931-457e-8029-c012acc428d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:11.803755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a72a4f-4931-457e-8029-c012acc428d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:11.805195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a72a4f-4931-457e-8029-c012acc428d5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:11.820291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a1168-ecea-4777-88e5-82a853e6cefd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:11.852884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:11.860613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb242f-f16a-4056-bdac-61e08e6ac36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:11.861278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb242f-f16a-4056-bdac-61e08e6ac36d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:11.861585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb242f-f16a-4056-bdac-61e08e6ac36d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:11.861865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb242f-f16a-4056-bdac-61e08e6ac36d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:11.863233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb242f-f16a-4056-bdac-61e08e6ac36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:11.864731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb242f-f16a-4056-bdac-61e08e6ac36d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:11.866320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 24/44] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:11.872385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb242f-f16a-4056-bdac-61e08e6ac36d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:11.919221 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 21/45] 10.222.0.55 () {60 vars in 1131 bytes} [Fri Sep 2 09:12:11 2022] POST /identity/v3/roles => generated 223 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:11.982242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb242f-f16a-4056-bdac-61e08e6ac36d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:12.017904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659985-a362-48e5-81c3-8a9e7b856feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:12.018540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659985-a362-48e5-81c3-8a9e7b856feb None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:12.018820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659985-a362-48e5-81c3-8a9e7b856feb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:12.019092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659985-a362-48e5-81c3-8a9e7b856feb None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:12.019765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1659985-a362-48e5-81c3-8a9e7b856feb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:12.021295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1659985-a362-48e5-81c3-8a9e7b856feb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:12.091537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 25/46] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:12:11 2022] POST /identity/v3/projects => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:12:13.533868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46eef8-ed37-4346-a60e-d46936fa3179 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:13.534418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46eef8-ed37-4346-a60e-d46936fa3179 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:13.534418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46eef8-ed37-4346-a60e-d46936fa3179 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:13.535771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 22/47] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:13.541147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b923c7a-61cf-4480-b3dd-3df483b45716 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:13.541537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b923c7a-61cf-4480-b3dd-3df483b45716 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:13.541817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b923c7a-61cf-4480-b3dd-3df483b45716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:13.560090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7b923c7a-61cf-4480-b3dd-3df483b45716 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:13.561248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7b923c7a-61cf-4480-b3dd-3df483b45716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:13.603039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:13.625551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 26/48] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:13.898267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46eef8-ed37-4346-a60e-d46936fa3179 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:13.989129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d62c-ec15-4e74-aabf-05f3a6d2322f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:13.989408 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d62c-ec15-4e74-aabf-05f3a6d2322f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:13.989680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d62c-ec15-4e74-aabf-05f3a6d2322f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:13.991053 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 27/49] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:13.997337 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db20ca-262f-4c8d-bc08-8d6fbaef2672 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:13.997620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db20ca-262f-4c8d-bc08-8d6fbaef2672 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:13.997918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db20ca-262f-4c8d-bc08-8d6fbaef2672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:14.015946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f6db20ca-262f-4c8d-bc08-8d6fbaef2672 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:14.017132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f6db20ca-262f-4c8d-bc08-8d6fbaef2672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:14.083038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 28/50] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:14.105297 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46eef8-ed37-4346-a60e-d46936fa3179 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:14.139411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8faeb9-9270-4c62-b2ea-fbd7bc55936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:14.140073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8faeb9-9270-4c62-b2ea-fbd7bc55936c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:14.140352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8faeb9-9270-4c62-b2ea-fbd7bc55936c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:14.140627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8faeb9-9270-4c62-b2ea-fbd7bc55936c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:14.150476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8faeb9-9270-4c62-b2ea-fbd7bc55936c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ee8faeb9-9270-4c62-b2ea-fbd7bc55936c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:14.155382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:14.156226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:14.156983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 23/51] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:12:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:14.162382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db20ca-262f-4c8d-bc08-8d6fbaef2672 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:14.258944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db20ca-262f-4c8d-bc08-8d6fbaef2672 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:14.349065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8faeb9-9270-4c62-b2ea-fbd7bc55936c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:14.372797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:14.385075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:14.397093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591432c4-273c-4b06-b1b0-579149dc1bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:14.397698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591432c4-273c-4b06-b1b0-579149dc1bef None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:14.397977 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591432c4-273c-4b06-b1b0-579149dc1bef None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:14.398246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591432c4-273c-4b06-b1b0-579149dc1bef None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:14.399008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591432c4-273c-4b06-b1b0-579149dc1bef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:14.399930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591432c4-273c-4b06-b1b0-579149dc1bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:14.401648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591432c4-273c-4b06-b1b0-579149dc1bef None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:14.413389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 29/52] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:14.419428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591432c4-273c-4b06-b1b0-579149dc1bef None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:14.455178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8faeb9-9270-4c62-b2ea-fbd7bc55936c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:14.488800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954251c-8c3e-487b-990d-9c31c67ed0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:14.489425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954251c-8c3e-487b-990d-9c31c67ed0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:14.489699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954251c-8c3e-487b-990d-9c31c67ed0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:14.489967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954251c-8c3e-487b-990d-9c31c67ed0b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:14.491068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954251c-8c3e-487b-990d-9c31c67ed0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:14.492568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954251c-8c3e-487b-990d-9c31c67ed0b9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:14.494197 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 24/53] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:14.499630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954251c-8c3e-487b-990d-9c31c67ed0b9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:14.516647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591432c4-273c-4b06-b1b0-579149dc1bef None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:14.551373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631cb3-1b48-4aae-ae7b-c6f3b24a3257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:14.552054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631cb3-1b48-4aae-ae7b-c6f3b24a3257 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:14.552335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631cb3-1b48-4aae-ae7b-c6f3b24a3257 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:14.552609 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631cb3-1b48-4aae-ae7b-c6f3b24a3257 None admin] PATH_INFO: `/v3/users/5721b6199cb646449381111a06a1e879` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:14.553755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3631cb3-1b48-4aae-ae7b-c6f3b24a3257 None admin] RBAC: Authorizing `identity:get_user(user_id=5721b6199cb646449381111a06a1e879)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:14.555197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3631cb3-1b48-4aae-ae7b-c6f3b24a3257 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:14.556967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 30/54] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:14 2022] GET /identity/v3/users/5721b6199cb646449381111a06a1e879 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:14.562685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631cb3-1b48-4aae-ae7b-c6f3b24a3257 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:14.596363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954251c-8c3e-487b-990d-9c31c67ed0b9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:14.597868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:14.603734 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:14.630542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3b207-2931-4290-af92-b9bc0ee25ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:14.631130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3b207-2931-4290-af92-b9bc0ee25ccd None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:14.631410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3b207-2931-4290-af92-b9bc0ee25ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:14.631686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3b207-2931-4290-af92-b9bc0ee25ccd None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:14.632358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3b207-2931-4290-af92-b9bc0ee25ccd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:14.634342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3b207-2931-4290-af92-b9bc0ee25ccd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:14.661496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631cb3-1b48-4aae-ae7b-c6f3b24a3257 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:14.693232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8dc05-5326-4080-9bc4-843ce77a81a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:14.693855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8dc05-5326-4080-9bc4-843ce77a81a5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:14.694177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8dc05-5326-4080-9bc4-843ce77a81a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:14.694637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8dc05-5326-4080-9bc4-843ce77a81a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:14.695848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8dc05-5326-4080-9bc4-843ce77a81a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:14.698339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8dc05-5326-4080-9bc4-843ce77a81a5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:14.699923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 31/55] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:14.705630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8dc05-5326-4080-9bc4-843ce77a81a5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:14.804502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 25/56] 10.222.0.55 () {60 vars in 1140 bytes} [Fri Sep 2 09:12:14 2022] POST /identity/v3/projects => generated 298 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:12:14.804709 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8dc05-5326-4080-9bc4-843ce77a81a5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:14.810506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:14.840621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6efd9-b473-4a44-9920-e68ed4f58975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:14.840732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6efd9-b473-4a44-9920-e68ed4f58975 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:14.840956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6efd9-b473-4a44-9920-e68ed4f58975 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:14.841233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6efd9-b473-4a44-9920-e68ed4f58975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:14.841983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6efd9-b473-4a44-9920-e68ed4f58975 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.domain.id=default, user.id=5721b6199cb646449381111a06a1e879) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:14.842293 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6efd9-b473-4a44-9920-e68ed4f58975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:14.843949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6efd9-b473-4a44-9920-e68ed4f58975 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:14.852844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 32/57] 10.222.0.55 () {56 vars in 1322 bytes} [Fri Sep 2 09:12:14 2022] GET /identity/v3/role_assignments?user.id=5721b6199cb646449381111a06a1e879&scope.domain.id=default&role.id=04d1bc62091440e189989e4b973a6627 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:16.694855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd5f14-3e7e-45e7-ad45-cc66bdd211cc None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:16.695373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd5f14-3e7e-45e7-ad45-cc66bdd211cc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:16.695457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd5f14-3e7e-45e7-ad45-cc66bdd211cc None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:16.697360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 26/58] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:16.702606 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cb84d-b9ab-4342-aee2-596156f09567 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:16.703018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cb84d-b9ab-4342-aee2-596156f09567 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:16.703167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cb84d-b9ab-4342-aee2-596156f09567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:16.720872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9e5cb84d-b9ab-4342-aee2-596156f09567 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:16.722055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9e5cb84d-b9ab-4342-aee2-596156f09567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:16.786424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 33/59] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:17.058835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd5f14-3e7e-45e7-ad45-cc66bdd211cc None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:17.156740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd5f14-3e7e-45e7-ad45-cc66bdd211cc None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:17.188601 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356418c1-fdfa-46ec-ade5-50657da0597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:17.189213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356418c1-fdfa-46ec-ade5-50657da0597f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:17.189493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356418c1-fdfa-46ec-ade5-50657da0597f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:17.189765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356418c1-fdfa-46ec-ade5-50657da0597f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:17.190867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356418c1-fdfa-46ec-ade5-50657da0597f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:17.192404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356418c1-fdfa-46ec-ade5-50657da0597f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:17.193880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 27/60] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:17.199740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cb84d-b9ab-4342-aee2-596156f09567 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:17.294015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:17.296976 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cb84d-b9ab-4342-aee2-596156f09567 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:17.331678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1956b4-a1bc-46da-baea-6879ff114780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:17.332546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1956b4-a1bc-46da-baea-6879ff114780 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:17.332832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1956b4-a1bc-46da-baea-6879ff114780 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:17.333107 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1956b4-a1bc-46da-baea-6879ff114780 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:17.333756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1956b4-a1bc-46da-baea-6879ff114780 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:17.335215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1956b4-a1bc-46da-baea-6879ff114780 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:17.434093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 34/61] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:12:17 2022] POST /identity/v3/users => generated 275 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:20.392218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108139f1-d6ee-466d-9dcb-04b672bbfea4 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:20.393234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108139f1-d6ee-466d-9dcb-04b672bbfea4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:20.393718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108139f1-d6ee-466d-9dcb-04b672bbfea4 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:20.395292 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 28/62] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:20.401601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99856062-3bcc-47f0-805d-2fd637e57b65 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:20.402011 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99856062-3bcc-47f0-805d-2fd637e57b65 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:20.402182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99856062-3bcc-47f0-805d-2fd637e57b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:20.425300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-99856062-3bcc-47f0-805d-2fd637e57b65 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:20.426518 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-99856062-3bcc-47f0-805d-2fd637e57b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:20.496186 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 35/63] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:20.501330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d2a7-4852-40dc-a810-19c720ae6688 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:20.501807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d2a7-4852-40dc-a810-19c720ae6688 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:20.502256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d2a7-4852-40dc-a810-19c720ae6688 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:20.503780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 29/64] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:20.509134 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aadd54-b86b-4001-8426-1c51ebe7bc3f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:20.509429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aadd54-b86b-4001-8426-1c51ebe7bc3f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:20.509710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aadd54-b86b-4001-8426-1c51ebe7bc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:20.533883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-56aadd54-b86b-4001-8426-1c51ebe7bc3f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:20.535078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-56aadd54-b86b-4001-8426-1c51ebe7bc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:20.628036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 36/65] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:20.766810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d2a7-4852-40dc-a810-19c720ae6688 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:20.796200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:20.857123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277630e5-77b1-4969-8171-2a0c324e3d6e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:20.857472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277630e5-77b1-4969-8171-2a0c324e3d6e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:20.857757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277630e5-77b1-4969-8171-2a0c324e3d6e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:20.859118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 37/66] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:20.872945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a538-dc14-4614-b2cc-f15720b6089a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:20.873233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a538-dc14-4614-b2cc-f15720b6089a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:20.873562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a538-dc14-4614-b2cc-f15720b6089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:20.904060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3b82a538-dc14-4614-b2cc-f15720b6089a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:20.905242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3b82a538-dc14-4614-b2cc-f15720b6089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:20.919557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d2a7-4852-40dc-a810-19c720ae6688 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:20.928270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:20.979045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2dfba-fb9a-4678-8faf-539324f924b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:20.980078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2dfba-fb9a-4678-8faf-539324f924b6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:20.980548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2dfba-fb9a-4678-8faf-539324f924b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:20.981029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2dfba-fb9a-4678-8faf-539324f924b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:20.992612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2dfba-fb9a-4678-8faf-539324f924b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:20.997790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 38/67] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:20.998840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82a538-dc14-4614-b2cc-f15720b6089a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b1c2dfba-fb9a-4678-8faf-539324f924b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:20.999275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:21.000143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:21.000902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:21.004266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 30/68] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:21.017055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2dfba-fb9a-4678-8faf-539324f924b6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:21.105770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82a538-dc14-4614-b2cc-f15720b6089a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:21.108681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:21.128474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2dfba-fb9a-4678-8faf-539324f924b6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:21.148482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1daa8-8aac-402e-a9a9-3dfe5e8daf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:21.149123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1daa8-8aac-402e-a9a9-3dfe5e8daf7d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.149431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1daa8-8aac-402e-a9a9-3dfe5e8daf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.149703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1daa8-8aac-402e-a9a9-3dfe5e8daf7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.161790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1daa8-8aac-402e-a9a9-3dfe5e8daf7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:21.165118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76858022-fa74-4798-ba45-6049930850e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:21.165789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76858022-fa74-4798-ba45-6049930850e3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.166134 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76858022-fa74-4798-ba45-6049930850e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.166490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76858022-fa74-4798-ba45-6049930850e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.167210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76858022-fa74-4798-ba45-6049930850e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:21.167579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76858022-fa74-4798-ba45-6049930850e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-cec1daa8-8aac-402e-a9a9-3dfe5e8daf7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:21.168382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:21.169197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:21.169930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:21.170488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76858022-fa74-4798-ba45-6049930850e3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:21.170560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 39/69] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:12:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:21.175584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a938da-b174-4c21-a795-c60bcb32241c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.175875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a938da-b174-4c21-a795-c60bcb32241c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.176170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a938da-b174-4c21-a795-c60bcb32241c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.177588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 40/70] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:21.183850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 31/71] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:21.183850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76858022-fa74-4798-ba45-6049930850e3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:21.184042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad150c-5c49-411b-b850-386b169de381 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.184042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad150c-5c49-411b-b850-386b169de381 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.184042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad150c-5c49-411b-b850-386b169de381 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.185076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 41/72] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:21.185988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91b32-3451-4dae-a145-dca3acfbaa18 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.186328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91b32-3451-4dae-a145-dca3acfbaa18 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.186605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91b32-3451-4dae-a145-dca3acfbaa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.199956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:21.206223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-75e91b32-3451-4dae-a145-dca3acfbaa18 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:21.207406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-75e91b32-3451-4dae-a145-dca3acfbaa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:21.276310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 42/73] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:21.277152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e91b32-3451-4dae-a145-dca3acfbaa18 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:21.308629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76858022-fa74-4798-ba45-6049930850e3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:21.344070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412bad3-d74d-4fa0-b96b-ecf5f2ab839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:21.345158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412bad3-d74d-4fa0-b96b-ecf5f2ab839d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.345158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412bad3-d74d-4fa0-b96b-ecf5f2ab839d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.345320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412bad3-d74d-4fa0-b96b-ecf5f2ab839d None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.345933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412bad3-d74d-4fa0-b96b-ecf5f2ab839d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:21.346239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412bad3-d74d-4fa0-b96b-ecf5f2ab839d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:21.347618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412bad3-d74d-4fa0-b96b-ecf5f2ab839d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:21.357670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 32/74] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:21.363550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88723d-56a5-4739-91ce-4ced33a4edfa None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.363839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88723d-56a5-4739-91ce-4ced33a4edfa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.364140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88723d-56a5-4739-91ce-4ced33a4edfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.380569 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e91b32-3451-4dae-a145-dca3acfbaa18 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:21.381744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:21.388080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5e88723d-56a5-4739-91ce-4ced33a4edfa None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:21.389292 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5e88723d-56a5-4739-91ce-4ced33a4edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:21.417584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d303-bc93-46e0-8d95-a9830091a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:21.418223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d303-bc93-46e0-8d95-a9830091a104 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.418484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d303-bc93-46e0-8d95-a9830091a104 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.418762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d303-bc93-46e0-8d95-a9830091a104 None admin] PATH_INFO: `/v3/users/4fca947af30f472881e3a8db5471e1b2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.422436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:21.435845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d303-bc93-46e0-8d95-a9830091a104 None admin] RBAC: Authorizing `identity:get_user(user_id=4fca947af30f472881e3a8db5471e1b2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:21.437381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d303-bc93-46e0-8d95-a9830091a104 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:21.444091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 43/75] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:21 2022] GET /identity/v3/users/4fca947af30f472881e3a8db5471e1b2 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:21.444091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d303-bc93-46e0-8d95-a9830091a104 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:21.462984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 33/76] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:21.464524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88723d-56a5-4739-91ce-4ced33a4edfa None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:21.571577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88723d-56a5-4739-91ce-4ced33a4edfa None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:21.571762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d303-bc93-46e0-8d95-a9830091a104 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:21.607199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56b5c9-e3a1-461f-972a-0e8acd815de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:21.607828 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56b5c9-e3a1-461f-972a-0e8acd815de6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.608138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56b5c9-e3a1-461f-972a-0e8acd815de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.608413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56b5c9-e3a1-461f-972a-0e8acd815de6 None admin] PATH_INFO: `/v3/users/5721b6199cb646449381111a06a1e879` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.609218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42c4b7-c8fd-4863-93a5-fdece6358f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:21.609523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56b5c9-e3a1-461f-972a-0e8acd815de6 None admin] RBAC: Authorizing `identity:get_user(user_id=5721b6199cb646449381111a06a1e879)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:21.609849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42c4b7-c8fd-4863-93a5-fdece6358f6d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.610130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42c4b7-c8fd-4863-93a5-fdece6358f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.610404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42c4b7-c8fd-4863-93a5-fdece6358f6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.610974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56b5c9-e3a1-461f-972a-0e8acd815de6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:21.618029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 34/77] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:21 2022] GET /identity/v3/users/5721b6199cb646449381111a06a1e879 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:21.618029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56b5c9-e3a1-461f-972a-0e8acd815de6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:21.618029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:21.626416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42c4b7-c8fd-4863-93a5-fdece6358f6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6b42c4b7-c8fd-4863-93a5-fdece6358f6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:21.631607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:21.632540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 44/78] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:12:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:21.636821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42c4b7-c8fd-4863-93a5-fdece6358f6d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:21.692223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:21.734886 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56b5c9-e3a1-461f-972a-0e8acd815de6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:21.737908 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42c4b7-c8fd-4863-93a5-fdece6358f6d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:21.767756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079a640-f069-441e-9dbb-3216867094ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:21.768389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079a640-f069-441e-9dbb-3216867094ae None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.768670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079a640-f069-441e-9dbb-3216867094ae None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.768944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079a640-f069-441e-9dbb-3216867094ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.770927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ae2d-c235-41da-9dc5-bbe4f8aca04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:21.771552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ae2d-c235-41da-9dc5-bbe4f8aca04b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.771828 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ae2d-c235-41da-9dc5-bbe4f8aca04b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.772127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ae2d-c235-41da-9dc5-bbe4f8aca04b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.773220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817ae2d-c235-41da-9dc5-bbe4f8aca04b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:21.775199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817ae2d-c235-41da-9dc5-bbe4f8aca04b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:21.776812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 45/79] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:21.777579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ae2d-c235-41da-9dc5-bbe4f8aca04b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:21.842918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079a640-f069-441e-9dbb-3216867094ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:21.844452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079a640-f069-441e-9dbb-3216867094ae None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:21.847019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:21.877052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ae2d-c235-41da-9dc5-bbe4f8aca04b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:21.899171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:21.911177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1df0a-7a84-40e5-960e-5317721a6c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:21.911789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1df0a-7a84-40e5-960e-5317721a6c5d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:21.912096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1df0a-7a84-40e5-960e-5317721a6c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:21.912369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1df0a-7a84-40e5-960e-5317721a6c5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:21.942023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 35/80] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:21.942942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079a640-f069-441e-9dbb-3216867094ae None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:21.983728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1df0a-7a84-40e5-960e-5317721a6c5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:21.985242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1df0a-7a84-40e5-960e-5317721a6c5d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:22.038812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079a640-f069-441e-9dbb-3216867094ae None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:22.041752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:22.072560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80176aec-f32d-477b-b56c-651a9ee7b6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:22.073158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80176aec-f32d-477b-b56c-651a9ee7b6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:22.073442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80176aec-f32d-477b-b56c-651a9ee7b6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:22.073716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80176aec-f32d-477b-b56c-651a9ee7b6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:22.074360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80176aec-f32d-477b-b56c-651a9ee7b6a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:22.074658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80176aec-f32d-477b-b56c-651a9ee7b6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:22.076060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80176aec-f32d-477b-b56c-651a9ee7b6a8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:22.083516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 46/81] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:22.083795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 36/82] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:12:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:22.088725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80176aec-f32d-477b-b56c-651a9ee7b6a8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:22.089442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1df0a-7a84-40e5-960e-5317721a6c5d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:22.113366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:22.183701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80176aec-f32d-477b-b56c-651a9ee7b6a8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:22.184950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1df0a-7a84-40e5-960e-5317721a6c5d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:22.217661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb046e-f599-4e5e-8493-8372e8e4cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:22.218267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb046e-f599-4e5e-8493-8372e8e4cdc7 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:22.218369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff250d-d2df-4552-b154-ec840f61c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:22.218544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb046e-f599-4e5e-8493-8372e8e4cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:22.218815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb046e-f599-4e5e-8493-8372e8e4cdc7 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:22.218934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff250d-d2df-4552-b154-ec840f61c847 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:22.219215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff250d-d2df-4552-b154-ec840f61c847 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:22.219452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb046e-f599-4e5e-8493-8372e8e4cdc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:22.219541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff250d-d2df-4552-b154-ec840f61c847 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:22.220930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb046e-f599-4e5e-8493-8372e8e4cdc7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:22.229814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff250d-d2df-4552-b154-ec840f61c847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-27ff250d-d2df-4552-b154-ec840f61c847 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:22.234941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:22.235759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:22.236558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 47/83] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:22.237353 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff250d-d2df-4552-b154-ec840f61c847 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:22.308175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 37/84] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:12:22 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:22.308980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb046e-f599-4e5e-8493-8372e8e4cdc7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:22.316676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:22.337653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff250d-d2df-4552-b154-ec840f61c847 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:22.356380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:22.379783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa900210-d5ea-429e-848c-1e0d2244995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:22.380381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa900210-d5ea-429e-848c-1e0d2244995e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:22.380693 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa900210-d5ea-429e-848c-1e0d2244995e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:22.380937 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa900210-d5ea-429e-848c-1e0d2244995e None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:22.382465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa900210-d5ea-429e-848c-1e0d2244995e None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:22.384499 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa900210-d5ea-429e-848c-1e0d2244995e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:22.386412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 48/85] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:22 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:22.392532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa900210-d5ea-429e-848c-1e0d2244995e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:22.441781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb046e-f599-4e5e-8493-8372e8e4cdc7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:22.484533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4a5eb-d877-4796-bb33-63c2480f50f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:22.485175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4a5eb-d877-4796-bb33-63c2480f50f1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:22.485448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4a5eb-d877-4796-bb33-63c2480f50f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:22.485723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4a5eb-d877-4796-bb33-63c2480f50f1 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:22.486971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4a5eb-d877-4796-bb33-63c2480f50f1 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:22.488765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4a5eb-d877-4796-bb33-63c2480f50f1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:22.490595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 38/86] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:22 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:22.491547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4a5eb-d877-4796-bb33-63c2480f50f1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:22.509563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa900210-d5ea-429e-848c-1e0d2244995e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:22.552789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf17571-f332-447e-8abf-869387d74a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:22.553422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf17571-f332-447e-8abf-869387d74a7d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:22.553705 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf17571-f332-447e-8abf-869387d74a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:22.553982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf17571-f332-447e-8abf-869387d74a7d None admin] PATH_INFO: `/v3/users/4fca947af30f472881e3a8db5471e1b2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:22.555139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf17571-f332-447e-8abf-869387d74a7d None admin] RBAC: Authorizing `identity:get_user(user_id=4fca947af30f472881e3a8db5471e1b2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:22.557269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf17571-f332-447e-8abf-869387d74a7d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:22.559038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 49/87] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:22 2022] GET /identity/v3/users/4fca947af30f472881e3a8db5471e1b2 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:22.559657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf17571-f332-447e-8abf-869387d74a7d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:22.585441 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:22.609485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:22.622055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4a5eb-d877-4796-bb33-63c2480f50f1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:22.661286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e43e-4f42-451d-ae43-d6357da59191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:22.661847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e43e-4f42-451d-ae43-d6357da59191 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:22.662127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e43e-4f42-451d-ae43-d6357da59191 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:22.662399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e43e-4f42-451d-ae43-d6357da59191 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:22.663068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e43e-4f42-451d-ae43-d6357da59191 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:22.663371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e43e-4f42-451d-ae43-d6357da59191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:22.664796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e43e-4f42-451d-ae43-d6357da59191 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:22.673740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 39/88] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:22.674649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e43e-4f42-451d-ae43-d6357da59191 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:22.685292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf17571-f332-447e-8abf-869387d74a7d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:22.728228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb27cc1-ddab-481f-9fe8-276430efad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:22.729156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27cc1-ddab-481f-9fe8-276430efad7c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:22.729437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27cc1-ddab-481f-9fe8-276430efad7c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:22.729712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27cc1-ddab-481f-9fe8-276430efad7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:22.730795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb27cc1-ddab-481f-9fe8-276430efad7c None admin] RBAC: Adding query filter params (role.id=8941b3ff5a124d0a918ea79de7649945, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6, user.id=4fca947af30f472881e3a8db5471e1b2) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:22.731111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb27cc1-ddab-481f-9fe8-276430efad7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:22.732767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb27cc1-ddab-481f-9fe8-276430efad7c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:22.739821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 50/89] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:22 2022] GET /identity/v3/role_assignments?user.id=4fca947af30f472881e3a8db5471e1b2&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:22.743962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb27cc1-ddab-481f-9fe8-276430efad7c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:22.847145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:22.857799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e43e-4f42-451d-ae43-d6357da59191 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:22.871457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb27cc1-ddab-481f-9fe8-276430efad7c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:22.937294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f0227-874e-4bd4-9e6b-babf3c8470f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:22.937842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0227-874e-4bd4-9e6b-babf3c8470f9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:22.938118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0227-874e-4bd4-9e6b-babf3c8470f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:22.938389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0227-874e-4bd4-9e6b-babf3c8470f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:22.940667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f0227-874e-4bd4-9e6b-babf3c8470f9 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6, user.id=5721b6199cb646449381111a06a1e879) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:22.940997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f0227-874e-4bd4-9e6b-babf3c8470f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:22.942485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f0227-874e-4bd4-9e6b-babf3c8470f9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:22.947679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8b75d-d1a8-45c9-ad48-f1472bb3d9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:22.948738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b75d-d1a8-45c9-ad48-f1472bb3d9ee None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:22.948738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b75d-d1a8-45c9-ad48-f1472bb3d9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:22.948922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b75d-d1a8-45c9-ad48-f1472bb3d9ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:22.955648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 40/90] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:22 2022] GET /identity/v3/role_assignments?user.id=5721b6199cb646449381111a06a1e879&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=04d1bc62091440e189989e4b973a6627 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:22.961521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f0227-874e-4bd4-9e6b-babf3c8470f9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:22.996251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:23.097025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8b75d-d1a8-45c9-ad48-f1472bb3d9ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:23.100594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8b75d-d1a8-45c9-ad48-f1472bb3d9ee None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:23.155916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f0227-874e-4bd4-9e6b-babf3c8470f9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:23.228430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:23.231283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e819b-1021-4938-a43a-8f91dcb5d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:23.231955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e819b-1021-4938-a43a-8f91dcb5d499 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:23.232237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e819b-1021-4938-a43a-8f91dcb5d499 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:23.232512 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e819b-1021-4938-a43a-8f91dcb5d499 None admin] PATH_INFO: `/v3/users/4fca947af30f472881e3a8db5471e1b2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:23.233652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e819b-1021-4938-a43a-8f91dcb5d499 None admin] RBAC: Authorizing `identity:get_user(user_id=4fca947af30f472881e3a8db5471e1b2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:23.235114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e819b-1021-4938-a43a-8f91dcb5d499 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:23.236820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 41/91] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:22 2022] GET /identity/v3/users/4fca947af30f472881e3a8db5471e1b2 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:23.242765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e819b-1021-4938-a43a-8f91dcb5d499 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:23.261443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 51/92] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:23.268879 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8b75d-d1a8-45c9-ad48-f1472bb3d9ee None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:23.396255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:23.425336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e819b-1021-4938-a43a-8f91dcb5d499 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:23.484154 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fc96d-855b-4114-9ddd-35fd257b1aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:23.484694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fc96d-855b-4114-9ddd-35fd257b1aec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:23.485230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fc96d-855b-4114-9ddd-35fd257b1aec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:23.485230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fc96d-855b-4114-9ddd-35fd257b1aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:23.515549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8b75d-d1a8-45c9-ad48-f1472bb3d9ee None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:23.614716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717eef0-8f8a-428f-ac7c-01d71f59bf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:23.615592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717eef0-8f8a-428f-ac7c-01d71f59bf6e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:23.616039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717eef0-8f8a-428f-ac7c-01d71f59bf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:23.616508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717eef0-8f8a-428f-ac7c-01d71f59bf6e None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:23.620582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717eef0-8f8a-428f-ac7c-01d71f59bf6e None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:23.622279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717eef0-8f8a-428f-ac7c-01d71f59bf6e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:23.624184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 52/93] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:23 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:23.629958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fc96d-855b-4114-9ddd-35fd257b1aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:23.631098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717eef0-8f8a-428f-ac7c-01d71f59bf6e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:23.631465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fc96d-855b-4114-9ddd-35fd257b1aec None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:23.743766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:23.817050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:23.850459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 42/94] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:23.853901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717eef0-8f8a-428f-ac7c-01d71f59bf6e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:23.860609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fc96d-855b-4114-9ddd-35fd257b1aec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:23.945912 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fdaa7-ae44-4bf2-93c6-7d2050977b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:23.946559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fdaa7-ae44-4bf2-93c6-7d2050977b45 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:23.946835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fdaa7-ae44-4bf2-93c6-7d2050977b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:23.947105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fdaa7-ae44-4bf2-93c6-7d2050977b45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:23.947832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fdaa7-ae44-4bf2-93c6-7d2050977b45 None admin] RBAC: Adding query filter params (role.id=5691b81a7afd45eca087af3298e82784, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6, user.id=4fca947af30f472881e3a8db5471e1b2) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:23.948198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fdaa7-ae44-4bf2-93c6-7d2050977b45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:23.949645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fdaa7-ae44-4bf2-93c6-7d2050977b45 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:23.960058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 53/95] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:23 2022] GET /identity/v3/role_assignments?user.id=4fca947af30f472881e3a8db5471e1b2&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=5691b81a7afd45eca087af3298e82784 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:24.064792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fc96d-855b-4114-9ddd-35fd257b1aec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:24.106729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8770b-91df-48eb-8c92-b8384ab54c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:24.107376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8770b-91df-48eb-8c92-b8384ab54c20 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:24.107654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8770b-91df-48eb-8c92-b8384ab54c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:24.108081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8770b-91df-48eb-8c92-b8384ab54c20 None admin] PATH_INFO: `/v3/projects/ee7f4c14e7ef4603b43e4110afa55a9b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:24.109132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8770b-91df-48eb-8c92-b8384ab54c20 None admin] RBAC: Authorizing `identity:get_project(project_id=ee7f4c14e7ef4603b43e4110afa55a9b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:24.110611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8770b-91df-48eb-8c92-b8384ab54c20 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:24.112281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 43/96] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:23 2022] GET /identity/v3/projects/ee7f4c14e7ef4603b43e4110afa55a9b => generated 312 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:24.118761 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fdaa7-ae44-4bf2-93c6-7d2050977b45 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:24.268821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fdaa7-ae44-4bf2-93c6-7d2050977b45 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:24.293227 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:24.325730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47b410-03e7-4c68-8a9d-d6831941334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:24.325730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47b410-03e7-4c68-8a9d-d6831941334e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:24.325730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47b410-03e7-4c68-8a9d-d6831941334e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:24.325730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47b410-03e7-4c68-8a9d-d6831941334e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:24.326102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47b410-03e7-4c68-8a9d-d6831941334e None admin] RBAC: Adding query filter params (role.id=8941b3ff5a124d0a918ea79de7649945, scope.project.id=ee7f4c14e7ef4603b43e4110afa55a9b, user.id=4fca947af30f472881e3a8db5471e1b2) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:24.326102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47b410-03e7-4c68-8a9d-d6831941334e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:24.326102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47b410-03e7-4c68-8a9d-d6831941334e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:24.332307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 54/97] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:24 2022] GET /identity/v3/role_assignments?user.id=4fca947af30f472881e3a8db5471e1b2&scope.project.id=ee7f4c14e7ef4603b43e4110afa55a9b&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:25.002644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ca526-741c-4965-b1df-19d8e38262ce None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.003625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ca526-741c-4965-b1df-19d8e38262ce None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.004153 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ca526-741c-4965-b1df-19d8e38262ce None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.006023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 44/98] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:25.012071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f127b96-47b1-4426-90ae-fcf5ce4ebc9c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.012889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f127b96-47b1-4426-90ae-fcf5ce4ebc9c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.013447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f127b96-47b1-4426-90ae-fcf5ce4ebc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.033821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9f127b96-47b1-4426-90ae-fcf5ce4ebc9c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:25.035315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9f127b96-47b1-4426-90ae-fcf5ce4ebc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:25.076031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785b0b-313c-4ab6-ad7e-a4fca16d3568 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.076648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785b0b-313c-4ab6-ad7e-a4fca16d3568 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.077131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785b0b-313c-4ab6-ad7e-a4fca16d3568 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.078642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 45/99] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:25.083699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e2e8-3caf-45a7-8d99-cdc2b5b55665 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.084226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e2e8-3caf-45a7-8d99-cdc2b5b55665 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.084690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e2e8-3caf-45a7-8d99-cdc2b5b55665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.105988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f162e2e8-3caf-45a7-8d99-cdc2b5b55665 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:25.107338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f162e2e8-3caf-45a7-8d99-cdc2b5b55665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:25.108554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 55/100] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:25.159071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:25.180120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 46/101] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:25.452279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f127b96-47b1-4426-90ae-fcf5ce4ebc9c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:25.511442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e2e8-3caf-45a7-8d99-cdc2b5b55665 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:25.587931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f127b96-47b1-4426-90ae-fcf5ce4ebc9c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:25.606198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:25.658283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fd391-ded9-4f52-ba2c-605ded2c0588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:25.659373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fd391-ded9-4f52-ba2c-605ded2c0588 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.659871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fd391-ded9-4f52-ba2c-605ded2c0588 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.660358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fd391-ded9-4f52-ba2c-605ded2c0588 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.665266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fd391-ded9-4f52-ba2c-605ded2c0588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:25.666934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fd391-ded9-4f52-ba2c-605ded2c0588 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:25.668950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 56/102] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:25.675400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fd391-ded9-4f52-ba2c-605ded2c0588 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:25.682206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e2e8-3caf-45a7-8d99-cdc2b5b55665 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:25.748586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1741b-5fe5-43bb-93f8-a2f55614019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:25.749541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1741b-5fe5-43bb-93f8-a2f55614019a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.750019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1741b-5fe5-43bb-93f8-a2f55614019a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.750491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1741b-5fe5-43bb-93f8-a2f55614019a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.771377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1741b-5fe5-43bb-93f8-a2f55614019a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-23a1741b-5fe5-43bb-93f8-a2f55614019a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:25.776602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:25.777419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:25.778169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:25.782710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 47/103] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:25.785574 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328759-20da-4a81-9e86-a29812a16940 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.788730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328759-20da-4a81-9e86-a29812a16940 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.789209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328759-20da-4a81-9e86-a29812a16940 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.791347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 48/104] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:25.793568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328759-20da-4a81-9e86-a29812a16940 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:25.848573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fd391-ded9-4f52-ba2c-605ded2c0588 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:25.871737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:25.894224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e13b5e-f64b-4c16-af22-f5cd491fd5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:25.895010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e13b5e-f64b-4c16-af22-f5cd491fd5d9 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.895291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e13b5e-f64b-4c16-af22-f5cd491fd5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.896073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e13b5e-f64b-4c16-af22-f5cd491fd5d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.896732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e13b5e-f64b-4c16-af22-f5cd491fd5d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:25.898641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e13b5e-f64b-4c16-af22-f5cd491fd5d9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:25.934586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328759-20da-4a81-9e86-a29812a16940 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:25.971710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb9a56-199a-44e3-b663-1e41ee2be7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:25.972340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb9a56-199a-44e3-b663-1e41ee2be7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.972616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb9a56-199a-44e3-b663-1e41ee2be7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.972888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb9a56-199a-44e3-b663-1e41ee2be7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.973548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb9a56-199a-44e3-b663-1e41ee2be7a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:25.973849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb9a56-199a-44e3-b663-1e41ee2be7a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:25.975332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb9a56-199a-44e3-b663-1e41ee2be7a3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:25.984466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 49/105] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:25.985944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263e12-0f9a-431c-9fc6-997981698aea None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.986231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263e12-0f9a-431c-9fc6-997981698aea None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.986501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263e12-0f9a-431c-9fc6-997981698aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.995201 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 57/106] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:12:25 2022] POST /identity/v3/projects => generated 302 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:12:25.996986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e27e6-6fb6-41dd-9be3-63840aa378d3 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:25.997487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e27e6-6fb6-41dd-9be3-63840aa378d3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:25.998022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e27e6-6fb6-41dd-9be3-63840aa378d3 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:25.999934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 58/107] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:26.006485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e27e6-6fb6-41dd-9be3-63840aa378d3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:26.012239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-bc263e12-0f9a-431c-9fc6-997981698aea None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:26.012797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bc263e12-0f9a-431c-9fc6-997981698aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:26.047190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:26.149605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e27e6-6fb6-41dd-9be3-63840aa378d3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:26.164391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 50/108] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:26.165948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d365-ed1a-43a5-bbe1-2b7ca23cf206 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:26.166237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d365-ed1a-43a5-bbe1-2b7ca23cf206 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:26.166513 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d365-ed1a-43a5-bbe1-2b7ca23cf206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:26.192980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea690b-e596-4592-83ac-49823150f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:26.194011 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea690b-e596-4592-83ac-49823150f822 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:26.194517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea690b-e596-4592-83ac-49823150f822 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:26.194968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea690b-e596-4592-83ac-49823150f822 None admin] PATH_INFO: `/v3/users/aaae6a93fa49437faabfb4f26a3efa3d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:26.209128 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d326d365-ed1a-43a5-bbe1-2b7ca23cf206 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:26.210491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d326d365-ed1a-43a5-bbe1-2b7ca23cf206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:26.213766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea690b-e596-4592-83ac-49823150f822 None admin] RBAC: Authorizing `identity:get_user(user_id=aaae6a93fa49437faabfb4f26a3efa3d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:26.215478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea690b-e596-4592-83ac-49823150f822 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:26.218909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 59/109] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:26 2022] GET /identity/v3/users/aaae6a93fa49437faabfb4f26a3efa3d => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:26.233873 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea690b-e596-4592-83ac-49823150f822 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:26.263135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:26.335330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:26.354587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea690b-e596-4592-83ac-49823150f822 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:26.368096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 51/110] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:26.439689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c513c87-8bc7-48bc-b925-aec448489368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:26.440643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c513c87-8bc7-48bc-b925-aec448489368 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:26.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c513c87-8bc7-48bc-b925-aec448489368 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:26.441626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c513c87-8bc7-48bc-b925-aec448489368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:26.505499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d365-ed1a-43a5-bbe1-2b7ca23cf206 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:26.517461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c513c87-8bc7-48bc-b925-aec448489368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:26.519221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c513c87-8bc7-48bc-b925-aec448489368 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:26.613575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:26.630417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 60/111] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:26.636555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c513c87-8bc7-48bc-b925-aec448489368 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:26.704892 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d365-ed1a-43a5-bbe1-2b7ca23cf206 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:26.740412 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62cbea-e552-4477-bf30-08e0efa46bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:26.741062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62cbea-e552-4477-bf30-08e0efa46bdf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:26.741345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62cbea-e552-4477-bf30-08e0efa46bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:26.741620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62cbea-e552-4477-bf30-08e0efa46bdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:26.752603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62cbea-e552-4477-bf30-08e0efa46bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ba62cbea-e552-4477-bf30-08e0efa46bdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:26.757531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:26.758551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:26.760224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 52/112] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:26.765024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62cbea-e552-4477-bf30-08e0efa46bdf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:26.791836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:26.842162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c513c87-8bc7-48bc-b925-aec448489368 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:26.880502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb2f24-1abe-4822-a67f-aa0416a7e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:26.881148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb2f24-1abe-4822-a67f-aa0416a7e36c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:26.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb2f24-1abe-4822-a67f-aa0416a7e36c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:26.881807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb2f24-1abe-4822-a67f-aa0416a7e36c None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:26.882934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb2f24-1abe-4822-a67f-aa0416a7e36c None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:26.884653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb2f24-1abe-4822-a67f-aa0416a7e36c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:26.886597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 61/113] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:26 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:26.887282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62cbea-e552-4477-bf30-08e0efa46bdf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:26.887401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb2f24-1abe-4822-a67f-aa0416a7e36c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:26.924931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45261872-f5fd-408e-9a02-c907680ca497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:26.925542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45261872-f5fd-408e-9a02-c907680ca497 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:26.925834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45261872-f5fd-408e-9a02-c907680ca497 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:26.926093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45261872-f5fd-408e-9a02-c907680ca497 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:26.926760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45261872-f5fd-408e-9a02-c907680ca497 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:26.927067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45261872-f5fd-408e-9a02-c907680ca497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:26.928761 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45261872-f5fd-408e-9a02-c907680ca497 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:26.943911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 53/114] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:26.943911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b6e66-d91b-4e63-bcb8-7606cd9cf66a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:26.943911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b6e66-d91b-4e63-bcb8-7606cd9cf66a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:26.943911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b6e66-d91b-4e63-bcb8-7606cd9cf66a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:26.943911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 54/115] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:26.943911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b6e66-d91b-4e63-bcb8-7606cd9cf66a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:26.959825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:27.011285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb2f24-1abe-4822-a67f-aa0416a7e36c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:27.044961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:27.050839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf834dc1-6e48-43fa-b339-4a8327b9b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:27.051488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834dc1-6e48-43fa-b339-4a8327b9b33d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.051766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834dc1-6e48-43fa-b339-4a8327b9b33d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.052068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834dc1-6e48-43fa-b339-4a8327b9b33d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.059113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b6e66-d91b-4e63-bcb8-7606cd9cf66a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:27.063419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf834dc1-6e48-43fa-b339-4a8327b9b33d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-bf834dc1-6e48-43fa-b339-4a8327b9b33d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:27.068424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:27.069270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:27.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 62/116] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:27.071115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf834dc1-6e48-43fa-b339-4a8327b9b33d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:27.105766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd81ac5-8d68-41fe-8fba-d8390ebbb647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:27.106402 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81ac5-8d68-41fe-8fba-d8390ebbb647 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.106691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81ac5-8d68-41fe-8fba-d8390ebbb647 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.106973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81ac5-8d68-41fe-8fba-d8390ebbb647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.107719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd81ac5-8d68-41fe-8fba-d8390ebbb647 None admin] RBAC: Adding query filter params (role.id=9b25ee87d1f947dcb8683d955a7c467f, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6, user.id=aaae6a93fa49437faabfb4f26a3efa3d) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:27.108067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd81ac5-8d68-41fe-8fba-d8390ebbb647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:27.110559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd81ac5-8d68-41fe-8fba-d8390ebbb647 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:27.117417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 55/117] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:26 2022] GET /identity/v3/role_assignments?user.id=aaae6a93fa49437faabfb4f26a3efa3d&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=9b25ee87d1f947dcb8683d955a7c467f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:27.118690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290bd8-7e9c-49e4-915a-a7e0e2b7adfc None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.118984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290bd8-7e9c-49e4-915a-a7e0e2b7adfc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.119270 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290bd8-7e9c-49e4-915a-a7e0e2b7adfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.139604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1a290bd8-7e9c-49e4-915a-a7e0e2b7adfc None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:27.140875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1a290bd8-7e9c-49e4-915a-a7e0e2b7adfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:27.230135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 56/118] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:27.231040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a290bd8-7e9c-49e4-915a-a7e0e2b7adfc None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:27.246054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf834dc1-6e48-43fa-b339-4a8327b9b33d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:27.262735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:27.284190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1e55c-e570-49ee-80cb-eb44ddbf42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:27.284885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1e55c-e570-49ee-80cb-eb44ddbf42db None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.285165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1e55c-e570-49ee-80cb-eb44ddbf42db None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.285437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1e55c-e570-49ee-80cb-eb44ddbf42db None admin] PATH_INFO: `/v3/users/5721b6199cb646449381111a06a1e879` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.286620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1e55c-e570-49ee-80cb-eb44ddbf42db None admin] RBAC: Authorizing `identity:get_user(user_id=5721b6199cb646449381111a06a1e879)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:27.288159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1e55c-e570-49ee-80cb-eb44ddbf42db None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:27.291386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 63/119] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:27 2022] GET /identity/v3/users/5721b6199cb646449381111a06a1e879 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:27.292607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bafdbf-aefb-4388-b742-b1527a149a65 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.292888 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bafdbf-aefb-4388-b742-b1527a149a65 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.293161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bafdbf-aefb-4388-b742-b1527a149a65 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.294440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 64/120] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:27.300715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c49a9-9d72-4d7f-b0f1-05adb7d041d3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.300976 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c49a9-9d72-4d7f-b0f1-05adb7d041d3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.301214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c49a9-9d72-4d7f-b0f1-05adb7d041d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.323255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-558c49a9-9d72-4d7f-b0f1-05adb7d041d3 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:27.324503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-558c49a9-9d72-4d7f-b0f1-05adb7d041d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:27.419340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 65/121] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:27.419845 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:27.420377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c49a9-9d72-4d7f-b0f1-05adb7d041d3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:27.449899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a290bd8-7e9c-49e4-915a-a7e0e2b7adfc None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:27.517785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feeaae6-8f26-457e-94ce-8ec4d0a08683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:27.518407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feeaae6-8f26-457e-94ce-8ec4d0a08683 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.518686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feeaae6-8f26-457e-94ce-8ec4d0a08683 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.518957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feeaae6-8f26-457e-94ce-8ec4d0a08683 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.519626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feeaae6-8f26-457e-94ce-8ec4d0a08683 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:27.519945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feeaae6-8f26-457e-94ce-8ec4d0a08683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:27.521529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feeaae6-8f26-457e-94ce-8ec4d0a08683 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:27.540467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 57/122] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:27.547191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feeaae6-8f26-457e-94ce-8ec4d0a08683 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:27.651032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c49a9-9d72-4d7f-b0f1-05adb7d041d3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:27.675451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:27.716054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badfbbc-80d3-45a9-a2a0-023bf53a2762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:27.716394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feeaae6-8f26-457e-94ce-8ec4d0a08683 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:27.716757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfbbc-80d3-45a9-a2a0-023bf53a2762 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.717043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfbbc-80d3-45a9-a2a0-023bf53a2762 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.717317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfbbc-80d3-45a9-a2a0-023bf53a2762 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.718514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badfbbc-80d3-45a9-a2a0-023bf53a2762 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:27.720024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badfbbc-80d3-45a9-a2a0-023bf53a2762 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:27.721671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 66/123] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:27 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:27.722447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badfbbc-80d3-45a9-a2a0-023bf53a2762 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:27.755573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692aad-934d-49cb-b74f-697bc687e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:27.756473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692aad-934d-49cb-b74f-697bc687e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.756758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692aad-934d-49cb-b74f-697bc687e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.757034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692aad-934d-49cb-b74f-697bc687e9d5 None admin] PATH_INFO: `/v3/users/4fca947af30f472881e3a8db5471e1b2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.758175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11692aad-934d-49cb-b74f-697bc687e9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=4fca947af30f472881e3a8db5471e1b2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:27.760263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11692aad-934d-49cb-b74f-697bc687e9d5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:27.762237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 58/124] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:27 2022] GET /identity/v3/users/4fca947af30f472881e3a8db5471e1b2 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:27.763033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692aad-934d-49cb-b74f-697bc687e9d5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:27.776585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:27.878778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badfbbc-80d3-45a9-a2a0-023bf53a2762 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:27.897863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692aad-934d-49cb-b74f-697bc687e9d5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:27.914318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce3586-9fbe-47a0-9b59-0e0c23785446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:27.915342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce3586-9fbe-47a0-9b59-0e0c23785446 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.915836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce3586-9fbe-47a0-9b59-0e0c23785446 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.916482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce3586-9fbe-47a0-9b59-0e0c23785446 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.927284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce3586-9fbe-47a0-9b59-0e0c23785446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-16ce3586-9fbe-47a0-9b59-0e0c23785446 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:27.933447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:27.934309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:27.935079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:27.939936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 67/125] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:12:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:27.939936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce3586-9fbe-47a0-9b59-0e0c23785446 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:27.942058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e508d8-34b5-4896-8924-4ca1af80822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:27.942207 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e508d8-34b5-4896-8924-4ca1af80822a None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:27.942457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e508d8-34b5-4896-8924-4ca1af80822a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:27.942735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e508d8-34b5-4896-8924-4ca1af80822a None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/users/5721b6199cb646449381111a06a1e879/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:27.945019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e508d8-34b5-4896-8924-4ca1af80822a None admin] RBAC: Authorizing `identity:create_grant(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6, user_id=5721b6199cb646449381111a06a1e879, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:27.947105 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e508d8-34b5-4896-8924-4ca1af80822a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:27.988223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:28.048761 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 59/126] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:12:27 2022] PUT /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/users/5721b6199cb646449381111a06a1e879/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:12:28.050066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e508d8-34b5-4896-8924-4ca1af80822a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:28.070562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce3586-9fbe-47a0-9b59-0e0c23785446 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:28.134516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c91ca2-61cd-42fd-8842-45ca18bed8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:28.135595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c91ca2-61cd-42fd-8842-45ca18bed8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:28.136124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c91ca2-61cd-42fd-8842-45ca18bed8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:28.136595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c91ca2-61cd-42fd-8842-45ca18bed8f2 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:28.137984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c91ca2-61cd-42fd-8842-45ca18bed8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:28.139775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c91ca2-61cd-42fd-8842-45ca18bed8f2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:28.142325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 68/127] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:27 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:28.143379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c91ca2-61cd-42fd-8842-45ca18bed8f2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:28.178706 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:28.247470 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e508d8-34b5-4896-8924-4ca1af80822a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:28.310652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae5ea9-cdcf-4043-bc0c-8fa3ded72e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:28.311287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae5ea9-cdcf-4043-bc0c-8fa3ded72e2d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:28.311565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae5ea9-cdcf-4043-bc0c-8fa3ded72e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:28.311837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae5ea9-cdcf-4043-bc0c-8fa3ded72e2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:28.325915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae5ea9-cdcf-4043-bc0c-8fa3ded72e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:28.331303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c91ca2-61cd-42fd-8842-45ca18bed8f2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f5ae5ea9-cdcf-4043-bc0c-8fa3ded72e2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:28.331440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:28.332265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:28.333064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 60/128] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:28.335184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae5ea9-cdcf-4043-bc0c-8fa3ded72e2d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:28.357101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:28.404689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b326fda-9118-4dac-a1d4-c6ef66aa0b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:28.408533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b326fda-9118-4dac-a1d4-c6ef66aa0b72 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:28.408836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b326fda-9118-4dac-a1d4-c6ef66aa0b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:28.409124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b326fda-9118-4dac-a1d4-c6ef66aa0b72 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:28.409846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b326fda-9118-4dac-a1d4-c6ef66aa0b72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:28.410155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b326fda-9118-4dac-a1d4-c6ef66aa0b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:28.411570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b326fda-9118-4dac-a1d4-c6ef66aa0b72 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:28.431928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 69/129] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:12:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:28.432718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b326fda-9118-4dac-a1d4-c6ef66aa0b72 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:28.512018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae5ea9-cdcf-4043-bc0c-8fa3ded72e2d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:28.541649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:28.547060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cafd19-e276-490f-ae2e-b95f25b272a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:28.547722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cafd19-e276-490f-ae2e-b95f25b272a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:28.548078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cafd19-e276-490f-ae2e-b95f25b272a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:28.548298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cafd19-e276-490f-ae2e-b95f25b272a5 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/users/4fca947af30f472881e3a8db5471e1b2/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:28.550427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cafd19-e276-490f-ae2e-b95f25b272a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6, user_id=4fca947af30f472881e3a8db5471e1b2, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:28.551912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cafd19-e276-490f-ae2e-b95f25b272a5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:28.590401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b326fda-9118-4dac-a1d4-c6ef66aa0b72 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:28.628536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad997c-3e9b-4b9e-92e3-e0f38da24c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:28.629175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad997c-3e9b-4b9e-92e3-e0f38da24c03 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:28.629452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad997c-3e9b-4b9e-92e3-e0f38da24c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:28.629719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad997c-3e9b-4b9e-92e3-e0f38da24c03 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:28.630425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad997c-3e9b-4b9e-92e3-e0f38da24c03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:28.630725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad997c-3e9b-4b9e-92e3-e0f38da24c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:28.632152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad997c-3e9b-4b9e-92e3-e0f38da24c03 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:28.640622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 70/130] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:28.641962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad997c-3e9b-4b9e-92e3-e0f38da24c03 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:28.677398 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 61/131] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:12:28 2022] PUT /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/users/4fca947af30f472881e3a8db5471e1b2/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:12:28.678740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f46c0-80de-4d1e-a201-f165b514808f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:28.679029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f46c0-80de-4d1e-a201-f165b514808f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:28.679302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f46c0-80de-4d1e-a201-f165b514808f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:28.680814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 62/132] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:28.685758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f46c0-80de-4d1e-a201-f165b514808f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:28.687659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:28.834868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad997c-3e9b-4b9e-92e3-e0f38da24c03 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:28.841386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f46c0-80de-4d1e-a201-f165b514808f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:28.897458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd66767-0f90-4833-8b78-d83f7e49ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:28.898107 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd66767-0f90-4833-8b78-d83f7e49ca73 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:28.898384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd66767-0f90-4833-8b78-d83f7e49ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:28.899207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd66767-0f90-4833-8b78-d83f7e49ca73 None admin] PATH_INFO: `/v3/users/4fca947af30f472881e3a8db5471e1b2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:28.900653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e03dd-adc5-471d-965f-3d33fb9b649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:28.901293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e03dd-adc5-471d-965f-3d33fb9b649c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:28.901567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e03dd-adc5-471d-965f-3d33fb9b649c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:28.901835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e03dd-adc5-471d-965f-3d33fb9b649c None admin] PATH_INFO: `/v3/users/4fca947af30f472881e3a8db5471e1b2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:28.903436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e03dd-adc5-471d-965f-3d33fb9b649c None admin] RBAC: Authorizing `identity:get_user(user_id=4fca947af30f472881e3a8db5471e1b2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:28.904260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd66767-0f90-4833-8b78-d83f7e49ca73 None admin] RBAC: Authorizing `identity:get_user(user_id=4fca947af30f472881e3a8db5471e1b2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:28.905717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd66767-0f90-4833-8b78-d83f7e49ca73 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:28.907195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e03dd-adc5-471d-965f-3d33fb9b649c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:28.908843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 63/133] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:28 2022] GET /identity/v3/users/4fca947af30f472881e3a8db5471e1b2 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:28.909993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cc421-fb30-4909-a85b-6e39b9d98628 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:28.911729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 71/134] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:28 2022] GET /identity/v3/users/4fca947af30f472881e3a8db5471e1b2 => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:28.916893 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd66767-0f90-4833-8b78-d83f7e49ca73 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:28.917294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cc421-fb30-4909-a85b-6e39b9d98628 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:28.917625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cc421-fb30-4909-a85b-6e39b9d98628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:28.955518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d58cc421-fb30-4909-a85b-6e39b9d98628 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:28.960135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d58cc421-fb30-4909-a85b-6e39b9d98628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:29.068269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:29.077027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 64/135] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:29.077879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cc421-fb30-4909-a85b-6e39b9d98628 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:29.128336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd66767-0f90-4833-8b78-d83f7e49ca73 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:29.148309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:29.187078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584154-4c78-48a1-b192-1bd0189de1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:29.187738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584154-4c78-48a1-b192-1bd0189de1ec None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:29.188052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584154-4c78-48a1-b192-1bd0189de1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:29.188489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584154-4c78-48a1-b192-1bd0189de1ec None admin] PATH_INFO: `/v3/projects/ee7f4c14e7ef4603b43e4110afa55a9b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:29.190466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f584154-4c78-48a1-b192-1bd0189de1ec None admin] RBAC: Authorizing `identity:get_project(project_id=ee7f4c14e7ef4603b43e4110afa55a9b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:29.191978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f584154-4c78-48a1-b192-1bd0189de1ec None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:29.193803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 72/136] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:28 2022] GET /identity/v3/projects/ee7f4c14e7ef4603b43e4110afa55a9b => generated 312 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:29.200022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584154-4c78-48a1-b192-1bd0189de1ec None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:29.352544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584154-4c78-48a1-b192-1bd0189de1ec None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:29.353609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cc421-fb30-4909-a85b-6e39b9d98628 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:29.389579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe1a6-ac7b-4dd9-a3d8-841696344d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:29.390223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe1a6-ac7b-4dd9-a3d8-841696344d70 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:29.390505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe1a6-ac7b-4dd9-a3d8-841696344d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:29.390781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe1a6-ac7b-4dd9-a3d8-841696344d70 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:29.391948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe1a6-ac7b-4dd9-a3d8-841696344d70 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:29.393457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe1a6-ac7b-4dd9-a3d8-841696344d70 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:29.395281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 65/137] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:29 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:29.400894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb313-6ef2-4bb8-857f-1883644ec40b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:29.401184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb313-6ef2-4bb8-857f-1883644ec40b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:29.401469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb313-6ef2-4bb8-857f-1883644ec40b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:29.402797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 66/138] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:29.403513 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eb313-6ef2-4bb8-857f-1883644ec40b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:29.444717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ae97f-e001-4c59-a2c6-b42571dd8e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:29.445551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ae97f-e001-4c59-a2c6-b42571dd8e79 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:29.445926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ae97f-e001-4c59-a2c6-b42571dd8e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:29.446847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ae97f-e001-4c59-a2c6-b42571dd8e79 None admin] PATH_INFO: `/v3/projects/ee7f4c14e7ef4603b43e4110afa55a9b/users/4fca947af30f472881e3a8db5471e1b2/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:29.453248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ae97f-e001-4c59-a2c6-b42571dd8e79 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee7f4c14e7ef4603b43e4110afa55a9b, user_id=4fca947af30f472881e3a8db5471e1b2, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:29.454866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ae97f-e001-4c59-a2c6-b42571dd8e79 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:29.466164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:29.513305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eb313-6ef2-4bb8-857f-1883644ec40b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:29.544539 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 73/139] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:12:29 2022] PUT /identity/v3/projects/ee7f4c14e7ef4603b43e4110afa55a9b/users/4fca947af30f472881e3a8db5471e1b2/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:12:29.546350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f06746-0054-4740-ae0d-894173963d4e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:29.546655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f06746-0054-4740-ae0d-894173963d4e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:29.547210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f06746-0054-4740-ae0d-894173963d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:29.551009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf509-8f18-4a0f-bfe1-fec4d8c3d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:29.551771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf509-8f18-4a0f-bfe1-fec4d8c3d268 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:29.552190 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf509-8f18-4a0f-bfe1-fec4d8c3d268 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:29.552590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf509-8f18-4a0f-bfe1-fec4d8c3d268 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/users/4fca947af30f472881e3a8db5471e1b2/roles/5691b81a7afd45eca087af3298e82784` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:29.556579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daf509-8f18-4a0f-bfe1-fec4d8c3d268 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6, user_id=4fca947af30f472881e3a8db5471e1b2, role_id=5691b81a7afd45eca087af3298e82784)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:29.558279 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daf509-8f18-4a0f-bfe1-fec4d8c3d268 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:29.571928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d0f06746-0054-4740-ae0d-894173963d4e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:29.573232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d0f06746-0054-4740-ae0d-894173963d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:29.600910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:29.651944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 74/140] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:29.652737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f06746-0054-4740-ae0d-894173963d4e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:29.677747 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 67/141] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:12:29 2022] PUT /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/users/4fca947af30f472881e3a8db5471e1b2/roles/5691b81a7afd45eca087af3298e82784 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:12:29.788311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f06746-0054-4740-ae0d-894173963d4e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:29.843917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27792dc9-ae39-45a4-b690-53658c9ae6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:29.843917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27792dc9-ae39-45a4-b690-53658c9ae6de None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:29.843917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27792dc9-ae39-45a4-b690-53658c9ae6de None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:29.843917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27792dc9-ae39-45a4-b690-53658c9ae6de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:29.844222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27792dc9-ae39-45a4-b690-53658c9ae6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:29.845464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27792dc9-ae39-45a4-b690-53658c9ae6de None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:29.847218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 75/142] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:29.853466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf509-8f18-4a0f-bfe1-fec4d8c3d268 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:30.010482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf509-8f18-4a0f-bfe1-fec4d8c3d268 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:30.029898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:30.055300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341b64-5205-4c53-bfa8-625ef11951b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:30.056094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341b64-5205-4c53-bfa8-625ef11951b1 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:30.056385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341b64-5205-4c53-bfa8-625ef11951b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:30.056662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341b64-5205-4c53-bfa8-625ef11951b1 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:30.057396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09341b64-5205-4c53-bfa8-625ef11951b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:30.058868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09341b64-5205-4c53-bfa8-625ef11951b1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:30.087977 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27792dc9-ae39-45a4-b690-53658c9ae6de None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:30.119845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:30.177491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 68/143] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:12:29 2022] POST /identity/v3/users => generated 283 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:30.218104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27792dc9-ae39-45a4-b690-53658c9ae6de None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:30.266987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab4f68-df53-414f-9f3c-bd9b1dd58db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:30.267554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab4f68-df53-414f-9f3c-bd9b1dd58db7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:30.267831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab4f68-df53-414f-9f3c-bd9b1dd58db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:30.268186 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab4f68-df53-414f-9f3c-bd9b1dd58db7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:30.281533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab4f68-df53-414f-9f3c-bd9b1dd58db7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7cab4f68-df53-414f-9f3c-bd9b1dd58db7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:30.286685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:30.287481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:30.288269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 76/144] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:12:30.294167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341b64-5205-4c53-bfa8-625ef11951b1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:30.421481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341b64-5205-4c53-bfa8-625ef11951b1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:30.465909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a86712-021a-4108-bcb9-4aa9db334cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:30.466537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a86712-021a-4108-bcb9-4aa9db334cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:30.466862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a86712-021a-4108-bcb9-4aa9db334cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:30.467142 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a86712-021a-4108-bcb9-4aa9db334cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:30.468033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a86712-021a-4108-bcb9-4aa9db334cb3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:30.468348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a86712-021a-4108-bcb9-4aa9db334cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:30.469806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a86712-021a-4108-bcb9-4aa9db334cb3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:30.478968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 69/145] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:30.484443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab4f68-df53-414f-9f3c-bd9b1dd58db7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:30.514953 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361b568-699c-4c07-b5ac-a50197c1aa8a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:30.515568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361b568-699c-4c07-b5ac-a50197c1aa8a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:30.516068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361b568-699c-4c07-b5ac-a50197c1aa8a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:30.517658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 70/146] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:12:30.522894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021baf9e-76a8-4733-bc8f-cb8c18499c59 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:30.523428 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021baf9e-76a8-4733-bc8f-cb8c18499c59 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:30.523918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021baf9e-76a8-4733-bc8f-cb8c18499c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:30.544068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-021baf9e-76a8-4733-bc8f-cb8c18499c59 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:30.545568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-021baf9e-76a8-4733-bc8f-cb8c18499c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:30.583157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:30.589720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:30.605512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab4f68-df53-414f-9f3c-bd9b1dd58db7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:30.635878 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 71/147] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:30.657085 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da363f-2893-47c8-b82b-e873aaca1bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:30.658082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da363f-2893-47c8-b82b-e873aaca1bae None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:30.658553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da363f-2893-47c8-b82b-e873aaca1bae None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:30.659013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da363f-2893-47c8-b82b-e873aaca1bae None admin] PATH_INFO: `/v3/users/aaae6a93fa49437faabfb4f26a3efa3d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:30.660487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da363f-2893-47c8-b82b-e873aaca1bae None admin] RBAC: Authorizing `identity:get_user(user_id=aaae6a93fa49437faabfb4f26a3efa3d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:30.662113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da363f-2893-47c8-b82b-e873aaca1bae None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:30.663963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 77/148] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:30 2022] GET /identity/v3/users/aaae6a93fa49437faabfb4f26a3efa3d => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:30.670144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021baf9e-76a8-4733-bc8f-cb8c18499c59 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:30.784337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021baf9e-76a8-4733-bc8f-cb8c18499c59 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:30.826471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d14592-db8d-476d-8ed8-a03f1cb34a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:30.827446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14592-db8d-476d-8ed8-a03f1cb34a7c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:30.827971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14592-db8d-476d-8ed8-a03f1cb34a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:30.828432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14592-db8d-476d-8ed8-a03f1cb34a7c None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:30.832594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d14592-db8d-476d-8ed8-a03f1cb34a7c None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:30.834335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d14592-db8d-476d-8ed8-a03f1cb34a7c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:30.836252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 72/149] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:30 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:30.846613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da363f-2893-47c8-b82b-e873aaca1bae None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:30.977555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da363f-2893-47c8-b82b-e873aaca1bae None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:31.019618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a4582-ee42-4038-8f39-7b92f83518bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:31.020397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4582-ee42-4038-8f39-7b92f83518bd None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:31.020678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4582-ee42-4038-8f39-7b92f83518bd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:31.020959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4582-ee42-4038-8f39-7b92f83518bd None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/users/aaae6a93fa49437faabfb4f26a3efa3d/roles/9b25ee87d1f947dcb8683d955a7c467f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:31.029307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a4582-ee42-4038-8f39-7b92f83518bd None admin] RBAC: Authorizing `identity:create_grant(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6, user_id=aaae6a93fa49437faabfb4f26a3efa3d, role_id=9b25ee87d1f947dcb8683d955a7c467f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:31.030838 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a4582-ee42-4038-8f39-7b92f83518bd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:31.100209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d14592-db8d-476d-8ed8-a03f1cb34a7c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:31.136785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:31.175043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 78/150] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:12:30 2022] PUT /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/users/aaae6a93fa49437faabfb4f26a3efa3d/roles/9b25ee87d1f947dcb8683d955a7c467f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:12:31.176278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5279-c605-424d-93db-42a0205a18ce None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:31.176466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5279-c605-424d-93db-42a0205a18ce None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:31.176831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5279-c605-424d-93db-42a0205a18ce None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:31.178202 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 79/151] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:31.187928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459828f6-bfc0-4fda-9d92-186bba5a1ac1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:31.188267 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459828f6-bfc0-4fda-9d92-186bba5a1ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:31.188527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459828f6-bfc0-4fda-9d92-186bba5a1ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:31.212320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-459828f6-bfc0-4fda-9d92-186bba5a1ac1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:31.214111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-459828f6-bfc0-4fda-9d92-186bba5a1ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:31.230941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:31.252174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d14592-db8d-476d-8ed8-a03f1cb34a7c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:31.322524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b6492-068f-45bb-830d-dc87b75fdb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:31.323628 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b6492-068f-45bb-830d-dc87b75fdb81 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:31.325197 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b6492-068f-45bb-830d-dc87b75fdb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:31.326430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b6492-068f-45bb-830d-dc87b75fdb81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:31.339413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 80/152] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:31.345136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b6492-068f-45bb-830d-dc87b75fdb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-617b6492-068f-45bb-830d-dc87b75fdb81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:31.350872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:31.351674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:31.352453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:31.354885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 73/153] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:12:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:31.360812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459828f6-bfc0-4fda-9d92-186bba5a1ac1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:31.482768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459828f6-bfc0-4fda-9d92-186bba5a1ac1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:31.531603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f90c18-66e3-4635-9bfc-0ceead4d7d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:31.532516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f90c18-66e3-4635-9bfc-0ceead4d7d58 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:31.532929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f90c18-66e3-4635-9bfc-0ceead4d7d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:31.533331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f90c18-66e3-4635-9bfc-0ceead4d7d58 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:31.534199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f90c18-66e3-4635-9bfc-0ceead4d7d58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:31.534632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f90c18-66e3-4635-9bfc-0ceead4d7d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:31.536188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f90c18-66e3-4635-9bfc-0ceead4d7d58 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:31.549786 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 81/154] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:31.555931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b6492-068f-45bb-830d-dc87b75fdb81 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:31.673042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:31.676432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b6492-068f-45bb-830d-dc87b75fdb81 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:31.713912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aeeb3-d1d5-4e02-bbec-e07a73396cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:31.714550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aeeb3-d1d5-4e02-bbec-e07a73396cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:31.714878 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aeeb3-d1d5-4e02-bbec-e07a73396cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:31.715151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aeeb3-d1d5-4e02-bbec-e07a73396cd0 None admin] PATH_INFO: `/v3/users/5721b6199cb646449381111a06a1e879` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:31.716365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4aeeb3-d1d5-4e02-bbec-e07a73396cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=5721b6199cb646449381111a06a1e879)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:31.717828 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4aeeb3-d1d5-4e02-bbec-e07a73396cd0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:31.719698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 74/155] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:31 2022] GET /identity/v3/users/5721b6199cb646449381111a06a1e879 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:31.725322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f90c18-66e3-4635-9bfc-0ceead4d7d58 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:31.735581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:31.802013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aeeb3-d1d5-4e02-bbec-e07a73396cd0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:31.880446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f90c18-66e3-4635-9bfc-0ceead4d7d58 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:31.949908 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf1f6b-ad1e-4425-bbc9-f167f30c1de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:31.950448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1f6b-ad1e-4425-bbc9-f167f30c1de3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:31.950721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1f6b-ad1e-4425-bbc9-f167f30c1de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:31.950989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1f6b-ad1e-4425-bbc9-f167f30c1de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:31.992518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aeeb3-d1d5-4e02-bbec-e07a73396cd0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:32.057281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b17952-b9c0-4955-9269-59175b6d1eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:32.057914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b17952-b9c0-4955-9269-59175b6d1eba None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:32.058193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b17952-b9c0-4955-9269-59175b6d1eba None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:32.058521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b17952-b9c0-4955-9269-59175b6d1eba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:32.075525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf1f6b-ad1e-4425-bbc9-f167f30c1de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:32.076895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b17952-b9c0-4955-9269-59175b6d1eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:32.077595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf1f6b-ad1e-4425-bbc9-f167f30c1de3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-17b17952-b9c0-4955-9269-59175b6d1eba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:32.081795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:32.082630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:32.083832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 75/156] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:32.089244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b17952-b9c0-4955-9269-59175b6d1eba None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:32.090115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:32.123019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:32.188738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 82/157] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:32.213132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf1f6b-ad1e-4425-bbc9-f167f30c1de3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:32.226889 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b17952-b9c0-4955-9269-59175b6d1eba None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:32.267623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ac62f-9171-48f9-9c8d-d798b9334473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:32.268425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ac62f-9171-48f9-9c8d-d798b9334473 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:32.268621 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ac62f-9171-48f9-9c8d-d798b9334473 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:32.268940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ac62f-9171-48f9-9c8d-d798b9334473 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:32.269611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ac62f-9171-48f9-9c8d-d798b9334473 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:32.269911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ac62f-9171-48f9-9c8d-d798b9334473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:32.271343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ac62f-9171-48f9-9c8d-d798b9334473 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:32.284641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 76/158] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:32.290408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ac62f-9171-48f9-9c8d-d798b9334473 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:32.433718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:32.450102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf1f6b-ad1e-4425-bbc9-f167f30c1de3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:32.462877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:32.467356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ac62f-9171-48f9-9c8d-d798b9334473 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:32.530021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526baeee-c0f5-470b-b5e0-fb76bd95d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:32.530660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526baeee-c0f5-470b-b5e0-fb76bd95d2fc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:32.530938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526baeee-c0f5-470b-b5e0-fb76bd95d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:32.531216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526baeee-c0f5-470b-b5e0-fb76bd95d2fc None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:32.536570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526baeee-c0f5-470b-b5e0-fb76bd95d2fc None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:32.537469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584fe0c-ab30-4694-a000-1d6544184f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:32.538030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526baeee-c0f5-470b-b5e0-fb76bd95d2fc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:32.538134 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584fe0c-ab30-4694-a000-1d6544184f2c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:32.538379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584fe0c-ab30-4694-a000-1d6544184f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:32.538649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584fe0c-ab30-4694-a000-1d6544184f2c None admin] PATH_INFO: `/v3/users/4fca947af30f472881e3a8db5471e1b2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:32.539794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584fe0c-ab30-4694-a000-1d6544184f2c None admin] RBAC: Authorizing `identity:get_user(user_id=4fca947af30f472881e3a8db5471e1b2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:32.540054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 83/159] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:32 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:32.541380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584fe0c-ab30-4694-a000-1d6544184f2c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:32.547375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 77/160] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:32 2022] GET /identity/v3/users/4fca947af30f472881e3a8db5471e1b2 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:32.548602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526baeee-c0f5-470b-b5e0-fb76bd95d2fc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:32.549121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584fe0c-ab30-4694-a000-1d6544184f2c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:32.746523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584fe0c-ab30-4694-a000-1d6544184f2c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:32.782012 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526baeee-c0f5-470b-b5e0-fb76bd95d2fc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:32.814183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d30fb-09e0-4f6f-8906-faf977caf5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:32.814801 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d30fb-09e0-4f6f-8906-faf977caf5aa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:32.815078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d30fb-09e0-4f6f-8906-faf977caf5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:32.815347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d30fb-09e0-4f6f-8906-faf977caf5aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:32.816105 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d30fb-09e0-4f6f-8906-faf977caf5aa None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6, user.id=5721b6199cb646449381111a06a1e879) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:32.816404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d30fb-09e0-4f6f-8906-faf977caf5aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:32.817860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d30fb-09e0-4f6f-8906-faf977caf5aa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:32.834013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 78/161] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:32 2022] GET /identity/v3/role_assignments?user.id=5721b6199cb646449381111a06a1e879&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=04d1bc62091440e189989e4b973a6627 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:32.847917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db71b48-ae68-4288-8fab-495e8ae9cdd0 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:32.847917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db71b48-ae68-4288-8fab-495e8ae9cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:32.847917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db71b48-ae68-4288-8fab-495e8ae9cdd0 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:32.847917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 79/162] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:32.859810 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa16f7-ccc6-4ed7-98b3-df75c8f2ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:32.860472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa16f7-ccc6-4ed7-98b3-df75c8f2ec02 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:32.860746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa16f7-ccc6-4ed7-98b3-df75c8f2ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:32.861016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa16f7-ccc6-4ed7-98b3-df75c8f2ec02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:32.902070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251127-b986-4941-becd-f529a5d56346 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:32.902354 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251127-b986-4941-becd-f529a5d56346 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:32.902769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251127-b986-4941-becd-f529a5d56346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:32.927091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:32.933348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-da251127-b986-4941-becd-f529a5d56346 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:32.934575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-da251127-b986-4941-becd-f529a5d56346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:32.950350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:32.973726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa16f7-ccc6-4ed7-98b3-df75c8f2ec02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:32.975211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa16f7-ccc6-4ed7-98b3-df75c8f2ec02 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:33.073529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 80/163] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:33.099409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 84/164] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:33.105423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251127-b986-4941-becd-f529a5d56346 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:33.248606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251127-b986-4941-becd-f529a5d56346 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:33.287104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee1f51-c9e3-4a27-bc7c-340e7007db2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:33.287721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1f51-c9e3-4a27-bc7c-340e7007db2a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:33.288032 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1f51-c9e3-4a27-bc7c-340e7007db2a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:33.288304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1f51-c9e3-4a27-bc7c-340e7007db2a None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:33.292900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee1f51-c9e3-4a27-bc7c-340e7007db2a None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:33.294438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee1f51-c9e3-4a27-bc7c-340e7007db2a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:33.296459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 81/165] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:33 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:33.302804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa16f7-ccc6-4ed7-98b3-df75c8f2ec02 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:33.400560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:33.430439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa16f7-ccc6-4ed7-98b3-df75c8f2ec02 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:33.467296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b1c7c-0720-4f39-806f-d79c3b238f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:33.467923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b1c7c-0720-4f39-806f-d79c3b238f1f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:33.468236 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b1c7c-0720-4f39-806f-d79c3b238f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:33.468514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b1c7c-0720-4f39-806f-d79c3b238f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:33.469238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b1c7c-0720-4f39-806f-d79c3b238f1f None admin] RBAC: Adding query filter params (role.id=8941b3ff5a124d0a918ea79de7649945, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6, user.id=4fca947af30f472881e3a8db5471e1b2) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:33.469541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b1c7c-0720-4f39-806f-d79c3b238f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:33.470985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b1c7c-0720-4f39-806f-d79c3b238f1f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:33.481312 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 85/166] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:33 2022] GET /identity/v3/role_assignments?user.id=4fca947af30f472881e3a8db5471e1b2&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:33.600281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c82571-f899-495b-819d-237a333c9d32 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:33.600934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c82571-f899-495b-819d-237a333c9d32 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:33.601577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c82571-f899-495b-819d-237a333c9d32 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:33.603664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 82/167] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:33.609676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d18d2b-21c7-4834-bbc2-bfffc9ba4729 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:33.609973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d18d2b-21c7-4834-bbc2-bfffc9ba4729 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:33.610224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d18d2b-21c7-4834-bbc2-bfffc9ba4729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:33.634663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c9d18d2b-21c7-4834-bbc2-bfffc9ba4729 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:33.635901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c9d18d2b-21c7-4834-bbc2-bfffc9ba4729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:33.717108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 86/168] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:33.796392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c82571-f899-495b-819d-237a333c9d32 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:33.817335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:33.926463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c82571-f899-495b-819d-237a333c9d32 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:33.964684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb6955-8c34-4358-b92a-6f3b6e42e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:33.965312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb6955-8c34-4358-b92a-6f3b6e42e19a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:33.965587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb6955-8c34-4358-b92a-6f3b6e42e19a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:33.965853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb6955-8c34-4358-b92a-6f3b6e42e19a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:33.982947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb6955-8c34-4358-b92a-6f3b6e42e19a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-79fb6955-8c34-4358-b92a-6f3b6e42e19a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:33.987848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:33.988971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:33.989744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 83/169] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:33.995042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d18d2b-21c7-4834-bbc2-bfffc9ba4729 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:34.095864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:34.099983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb6955-8c34-4358-b92a-6f3b6e42e19a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:34.143097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d18d2b-21c7-4834-bbc2-bfffc9ba4729 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:34.205224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fbdb0-eddb-4646-975a-5439be7ae6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:34.205849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fbdb0-eddb-4646-975a-5439be7ae6bd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:34.206125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fbdb0-eddb-4646-975a-5439be7ae6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:34.206396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fbdb0-eddb-4646-975a-5439be7ae6bd None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:34.207058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fbdb0-eddb-4646-975a-5439be7ae6bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:34.207360 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fbdb0-eddb-4646-975a-5439be7ae6bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:34.208773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fbdb0-eddb-4646-975a-5439be7ae6bd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:34.228402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 87/170] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:34.233545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fbdb0-eddb-4646-975a-5439be7ae6bd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:34.241010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:34.293477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb6955-8c34-4358-b92a-6f3b6e42e19a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:34.336686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e73c7-87cd-4a8f-865d-fef0b1a15bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:34.337947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e73c7-87cd-4a8f-865d-fef0b1a15bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:34.338271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e73c7-87cd-4a8f-865d-fef0b1a15bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:34.338483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e73c7-87cd-4a8f-865d-fef0b1a15bb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:34.354586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e73c7-87cd-4a8f-865d-fef0b1a15bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-490e73c7-87cd-4a8f-865d-fef0b1a15bb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:34.359760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:34.368723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 84/171] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:12:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:34.369478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e73c7-87cd-4a8f-865d-fef0b1a15bb6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:34.395505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fbdb0-eddb-4646-975a-5439be7ae6bd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:34.453190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:34.467685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082ca96-5e38-45a5-9e28-9498b3f76ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:34.470183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082ca96-5e38-45a5-9e28-9498b3f76ade None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:34.470863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082ca96-5e38-45a5-9e28-9498b3f76ade None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:34.472017 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082ca96-5e38-45a5-9e28-9498b3f76ade None admin] PATH_INFO: `/v3/users/4fca947af30f472881e3a8db5471e1b2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:34.478738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082ca96-5e38-45a5-9e28-9498b3f76ade None admin] RBAC: Authorizing `identity:get_user(user_id=4fca947af30f472881e3a8db5471e1b2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:34.480481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082ca96-5e38-45a5-9e28-9498b3f76ade None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:34.482303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 88/172] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:34 2022] GET /identity/v3/users/4fca947af30f472881e3a8db5471e1b2 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:34.489155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082ca96-5e38-45a5-9e28-9498b3f76ade None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:34.554748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e73c7-87cd-4a8f-865d-fef0b1a15bb6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:34.611423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:34.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082ca96-5e38-45a5-9e28-9498b3f76ade None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:34.621214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f0510-c9ce-4583-a0c4-2d59ab2acd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:34.621826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f0510-c9ce-4583-a0c4-2d59ab2acd43 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:34.622100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f0510-c9ce-4583-a0c4-2d59ab2acd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:34.622370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f0510-c9ce-4583-a0c4-2d59ab2acd43 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:34.623029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f0510-c9ce-4583-a0c4-2d59ab2acd43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:34.623324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f0510-c9ce-4583-a0c4-2d59ab2acd43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:34.624768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f0510-c9ce-4583-a0c4-2d59ab2acd43 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:34.643818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 85/173] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:12:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:34.645071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83144f6-0f6b-48f0-8a58-9accb2889381 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:34.645351 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83144f6-0f6b-48f0-8a58-9accb2889381 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:34.645806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83144f6-0f6b-48f0-8a58-9accb2889381 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:34.646845 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 86/174] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:34.652389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83144f6-0f6b-48f0-8a58-9accb2889381 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:34.659303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f219d98-20f3-48c0-a46f-130bcc01450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:34.660246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f219d98-20f3-48c0-a46f-130bcc01450a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:34.660715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f219d98-20f3-48c0-a46f-130bcc01450a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:34.661175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f219d98-20f3-48c0-a46f-130bcc01450a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:34.756608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:34.761715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f219d98-20f3-48c0-a46f-130bcc01450a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:34.763560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f219d98-20f3-48c0-a46f-130bcc01450a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:34.856231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83144f6-0f6b-48f0-8a58-9accb2889381 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:34.872811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 89/175] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:34.874458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d7789-705b-4ecf-a10d-f1c63c2dc517 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:34.874837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d7789-705b-4ecf-a10d-f1c63c2dc517 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:34.875203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d7789-705b-4ecf-a10d-f1c63c2dc517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:34.904990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-234d7789-705b-4ecf-a10d-f1c63c2dc517 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:34.906193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-234d7789-705b-4ecf-a10d-f1c63c2dc517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:34.925685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88824f67-27fa-479a-a286-a5549510a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:34.926326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88824f67-27fa-479a-a286-a5549510a81a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:34.926600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88824f67-27fa-479a-a286-a5549510a81a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:34.926875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88824f67-27fa-479a-a286-a5549510a81a None admin] PATH_INFO: `/v3/users/4fca947af30f472881e3a8db5471e1b2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:34.930273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88824f67-27fa-479a-a286-a5549510a81a None admin] RBAC: Authorizing `identity:get_user(user_id=4fca947af30f472881e3a8db5471e1b2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:34.934157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88824f67-27fa-479a-a286-a5549510a81a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:34.938979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 87/176] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:34 2022] GET /identity/v3/users/4fca947af30f472881e3a8db5471e1b2 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:34.939812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88824f67-27fa-479a-a286-a5549510a81a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:35.004986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 90/177] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:35.006218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d7789-705b-4ecf-a10d-f1c63c2dc517 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:35.022537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:35.039588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:35.067162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88824f67-27fa-479a-a286-a5549510a81a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:35.105268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d41f2-9aea-43eb-ac1a-ea65b74404b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:35.106498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d41f2-9aea-43eb-ac1a-ea65b74404b6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.107122 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d41f2-9aea-43eb-ac1a-ea65b74404b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.107591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d41f2-9aea-43eb-ac1a-ea65b74404b6 None admin] PATH_INFO: `/v3/projects/ee7f4c14e7ef4603b43e4110afa55a9b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.108968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d41f2-9aea-43eb-ac1a-ea65b74404b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ee7f4c14e7ef4603b43e4110afa55a9b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:35.111040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d41f2-9aea-43eb-ac1a-ea65b74404b6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:35.112934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 88/178] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:34 2022] GET /identity/v3/projects/ee7f4c14e7ef4603b43e4110afa55a9b => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:35.114813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2f954-f07e-4970-b082-c14a4a5402a4 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.115344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2f954-f07e-4970-b082-c14a4a5402a4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.115811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2f954-f07e-4970-b082-c14a4a5402a4 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.122460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 89/179] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:35.124014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f5fa-a2b4-4553-b658-973256f00913 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.124548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f5fa-a2b4-4553-b658-973256f00913 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.125037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f5fa-a2b4-4553-b658-973256f00913 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.126308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d7789-705b-4ecf-a10d-f1c63c2dc517 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:35.126715 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 90/180] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:35.127700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78f5fa-a2b4-4553-b658-973256f00913 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:35.170797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d964858-42b6-482a-b30a-1b1be2d11bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:35.171404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d964858-42b6-482a-b30a-1b1be2d11bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.171680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d964858-42b6-482a-b30a-1b1be2d11bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.171974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d964858-42b6-482a-b30a-1b1be2d11bb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.246694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78f5fa-a2b4-4553-b658-973256f00913 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:35.257555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d964858-42b6-482a-b30a-1b1be2d11bb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:35.259099 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d964858-42b6-482a-b30a-1b1be2d11bb9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:35.279005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:35.285502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb1bdf-44e7-4055-8a0c-750ce9e21ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:35.285959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:35.286147 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb1bdf-44e7-4055-8a0c-750ce9e21ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.292577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb1bdf-44e7-4055-8a0c-750ce9e21ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.292577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb1bdf-44e7-4055-8a0c-750ce9e21ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.292577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb1bdf-44e7-4055-8a0c-750ce9e21ca5 None admin] RBAC: Adding query filter params (role.id=8941b3ff5a124d0a918ea79de7649945, scope.project.id=ee7f4c14e7ef4603b43e4110afa55a9b, user.id=4fca947af30f472881e3a8db5471e1b2) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:35.292577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb1bdf-44e7-4055-8a0c-750ce9e21ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:35.292577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb1bdf-44e7-4055-8a0c-750ce9e21ca5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:35.295594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 91/181] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:35 2022] GET /identity/v3/role_assignments?user.id=4fca947af30f472881e3a8db5471e1b2&scope.project.id=ee7f4c14e7ef4603b43e4110afa55a9b&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:35.296810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109cc3b-3b6c-4a72-b619-c732c910286b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.297090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109cc3b-3b6c-4a72-b619-c732c910286b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.297358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109cc3b-3b6c-4a72-b619-c732c910286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.316614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2109cc3b-3b6c-4a72-b619-c732c910286b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:35.317849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2109cc3b-3b6c-4a72-b619-c732c910286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:35.390839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 92/182] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:35.393869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71301bce-200e-488a-bbe6-9aadf23558e8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.393869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71301bce-200e-488a-bbe6-9aadf23558e8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.393869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71301bce-200e-488a-bbe6-9aadf23558e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.413785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-71301bce-200e-488a-bbe6-9aadf23558e8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:35.415089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-71301bce-200e-488a-bbe6-9aadf23558e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:35.435490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 91/183] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:35.436919 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff1a67-ac34-482a-a1e7-1237e4606cc1 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.437324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff1a67-ac34-482a-a1e7-1237e4606cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.437842 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff1a67-ac34-482a-a1e7-1237e4606cc1 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.439505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 92/184] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:35.444862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff1a67-ac34-482a-a1e7-1237e4606cc1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:35.504895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 93/185] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:35.506120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71301bce-200e-488a-bbe6-9aadf23558e8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:35.570858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff1a67-ac34-482a-a1e7-1237e4606cc1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:35.585730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:35.602008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:35.611668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b9066-641f-47b8-a6ea-cefebe08268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:35.612543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b9066-641f-47b8-a6ea-cefebe08268a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.612945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b9066-641f-47b8-a6ea-cefebe08268a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.613614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b9066-641f-47b8-a6ea-cefebe08268a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.632358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b9066-641f-47b8-a6ea-cefebe08268a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-406b9066-641f-47b8-a6ea-cefebe08268a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:35.637555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:35.638614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:35.639649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 93/186] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:12:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:35.641851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4af6bd-8cae-4ddc-b5ff-5873c03da7ea None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.641851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4af6bd-8cae-4ddc-b5ff-5873c03da7ea None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.641851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4af6bd-8cae-4ddc-b5ff-5873c03da7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.652463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71301bce-200e-488a-bbe6-9aadf23558e8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:35.660280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ea4af6bd-8cae-4ddc-b5ff-5873c03da7ea None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:35.661469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ea4af6bd-8cae-4ddc-b5ff-5873c03da7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:35.693970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc79e-e94f-480e-a5d5-0a746f702170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:35.694815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc79e-e94f-480e-a5d5-0a746f702170 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.695092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc79e-e94f-480e-a5d5-0a746f702170 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.695368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc79e-e94f-480e-a5d5-0a746f702170 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.697535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dc79e-e94f-480e-a5d5-0a746f702170 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:35.699523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dc79e-e94f-480e-a5d5-0a746f702170 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:35.701585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 94/187] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:35 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:35.702466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc79e-e94f-480e-a5d5-0a746f702170 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:35.738820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 94/188] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:35.739841 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4af6bd-8cae-4ddc-b5ff-5873c03da7ea None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:35.815485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc79e-e94f-480e-a5d5-0a746f702170 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:35.842100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:35.851238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4af6bd-8cae-4ddc-b5ff-5873c03da7ea None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:35.856037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7ad1b-c030-4649-94cf-e186e5409e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:35.858815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7ad1b-c030-4649-94cf-e186e5409e1f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.858815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7ad1b-c030-4649-94cf-e186e5409e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.858815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7ad1b-c030-4649-94cf-e186e5409e1f None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.858815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7ad1b-c030-4649-94cf-e186e5409e1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:35.858815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7ad1b-c030-4649-94cf-e186e5409e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:35.859591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7ad1b-c030-4649-94cf-e186e5409e1f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:35.870230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 95/189] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:35.870876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7ad1b-c030-4649-94cf-e186e5409e1f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:35.876465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:35.895270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a35f3-56d4-403d-9377-fdb1ab9453ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:35.896078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a35f3-56d4-403d-9377-fdb1ab9453ef None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:35.896355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a35f3-56d4-403d-9377-fdb1ab9453ef None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:35.896615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a35f3-56d4-403d-9377-fdb1ab9453ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:35.897710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a35f3-56d4-403d-9377-fdb1ab9453ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:35.899149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a35f3-56d4-403d-9377-fdb1ab9453ef None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:35.906283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 95/190] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:35.906972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a35f3-56d4-403d-9377-fdb1ab9453ef None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:35.978366 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7ad1b-c030-4649-94cf-e186e5409e1f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:36.010500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a35f3-56d4-403d-9377-fdb1ab9453ef None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:36.012849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e912c7-4a45-44f7-96c0-e1e05d812b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:36.013454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e912c7-4a45-44f7-96c0-e1e05d812b02 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:36.013731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e912c7-4a45-44f7-96c0-e1e05d812b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:36.014005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e912c7-4a45-44f7-96c0-e1e05d812b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:36.014728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e912c7-4a45-44f7-96c0-e1e05d812b02 None admin] RBAC: Adding query filter params (role.id=5691b81a7afd45eca087af3298e82784, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6, user.id=4fca947af30f472881e3a8db5471e1b2) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:36.015032 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e912c7-4a45-44f7-96c0-e1e05d812b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:36.016557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e912c7-4a45-44f7-96c0-e1e05d812b02 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:36.022328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 96/191] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:35 2022] GET /identity/v3/role_assignments?user.id=4fca947af30f472881e3a8db5471e1b2&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=5691b81a7afd45eca087af3298e82784 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:36.023098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e912c7-4a45-44f7-96c0-e1e05d812b02 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:36.057105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614957a-591e-4f5f-9684-10e3ec15c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:36.057757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614957a-591e-4f5f-9684-10e3ec15c98c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:36.058032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614957a-591e-4f5f-9684-10e3ec15c98c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:36.058310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614957a-591e-4f5f-9684-10e3ec15c98c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:36.070029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614957a-591e-4f5f-9684-10e3ec15c98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1614957a-591e-4f5f-9684-10e3ec15c98c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:36.076221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:36.077350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 96/192] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:36.078292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614957a-591e-4f5f-9684-10e3ec15c98c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:36.091448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:36.132257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:36.152871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e912c7-4a45-44f7-96c0-e1e05d812b02 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:36.193897 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3de03-d95a-4997-8608-f8f195b1d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:36.194536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3de03-d95a-4997-8608-f8f195b1d04a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:36.194802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3de03-d95a-4997-8608-f8f195b1d04a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:36.195070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3de03-d95a-4997-8608-f8f195b1d04a None admin] PATH_INFO: `/v3/users/42325eab500f4e779e746472031fe2cd` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:36.198162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614957a-591e-4f5f-9684-10e3ec15c98c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:36.214419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3de03-d95a-4997-8608-f8f195b1d04a None admin] RBAC: Authorizing `identity:get_user(user_id=42325eab500f4e779e746472031fe2cd)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:36.215927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3de03-d95a-4997-8608-f8f195b1d04a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:36.217624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 97/193] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:36 2022] GET /identity/v3/users/42325eab500f4e779e746472031fe2cd => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:36.220698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3de03-d95a-4997-8608-f8f195b1d04a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:36.240399 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639512ff-c53e-485a-a84c-e831d6e8dc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:36.241012 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639512ff-c53e-485a-a84c-e831d6e8dc8f None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:36.241292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639512ff-c53e-485a-a84c-e831d6e8dc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:36.241574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639512ff-c53e-485a-a84c-e831d6e8dc8f None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:36.243198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639512ff-c53e-485a-a84c-e831d6e8dc8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:36.244247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639512ff-c53e-485a-a84c-e831d6e8dc8f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:36.319812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3de03-d95a-4997-8608-f8f195b1d04a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:36.327513 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:36.347745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 97/194] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:12:36 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:36.347745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639512ff-c53e-485a-a84c-e831d6e8dc8f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:36.355797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3e3d8-629a-4602-9ddb-e507c734dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:36.356498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3e3d8-629a-4602-9ddb-e507c734dfff None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:36.356776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3e3d8-629a-4602-9ddb-e507c734dfff None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:36.357048 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3e3d8-629a-4602-9ddb-e507c734dfff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:36.370194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3e3d8-629a-4602-9ddb-e507c734dfff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-90e3e3d8-629a-4602-9ddb-e507c734dfff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:36.375650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:36.377244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 98/195] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:12:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:36.378010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3e3d8-629a-4602-9ddb-e507c734dfff None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:36.455125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639512ff-c53e-485a-a84c-e831d6e8dc8f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:36.456829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:36.494133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0e03e-7b8d-44e7-848e-4a2b0d3fed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:36.494808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0e03e-7b8d-44e7-848e-4a2b0d3fed43 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:36.495086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0e03e-7b8d-44e7-848e-4a2b0d3fed43 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:36.495402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0e03e-7b8d-44e7-848e-4a2b0d3fed43 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:36.496120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0e03e-7b8d-44e7-848e-4a2b0d3fed43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:36.496422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0e03e-7b8d-44e7-848e-4a2b0d3fed43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:36.497813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0e03e-7b8d-44e7-848e-4a2b0d3fed43 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:36.498193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3e3d8-629a-4602-9ddb-e507c734dfff None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:36.507212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 98/196] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:36.508377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0e03e-7b8d-44e7-848e-4a2b0d3fed43 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:36.538572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2198ab-b5a3-4007-ac50-329aa91c0f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:36.539187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2198ab-b5a3-4007-ac50-329aa91c0f6a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:36.539460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2198ab-b5a3-4007-ac50-329aa91c0f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:36.539733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2198ab-b5a3-4007-ac50-329aa91c0f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:36.584210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:36.628147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0e03e-7b8d-44e7-848e-4a2b0d3fed43 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:36.629972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2198ab-b5a3-4007-ac50-329aa91c0f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:36.632405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2198ab-b5a3-4007-ac50-329aa91c0f6a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:36.665032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee80eae-b446-4ffd-9ff5-ce8310765bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:36.666560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80eae-b446-4ffd-9ff5-ce8310765bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:36.666560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80eae-b446-4ffd-9ff5-ce8310765bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:36.666765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80eae-b446-4ffd-9ff5-ce8310765bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:36.667314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee80eae-b446-4ffd-9ff5-ce8310765bd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:36.667616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee80eae-b446-4ffd-9ff5-ce8310765bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:36.669042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee80eae-b446-4ffd-9ff5-ce8310765bd6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:36.678208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 99/197] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:12:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:36.678852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee80eae-b446-4ffd-9ff5-ce8310765bd6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:36.716455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:36.757578 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 99/198] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:36.759104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2198ab-b5a3-4007-ac50-329aa91c0f6a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:36.811565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee80eae-b446-4ffd-9ff5-ce8310765bd6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:36.834624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:36.862121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923c634-ba63-49ff-84ff-77cae8f7b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:36.862765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923c634-ba63-49ff-84ff-77cae8f7b47e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:36.863421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923c634-ba63-49ff-84ff-77cae8f7b47e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:36.863983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923c634-ba63-49ff-84ff-77cae8f7b47e None admin] PATH_INFO: `/v3/users/aaae6a93fa49437faabfb4f26a3efa3d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:36.865421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923c634-ba63-49ff-84ff-77cae8f7b47e None admin] RBAC: Authorizing `identity:get_user(user_id=aaae6a93fa49437faabfb4f26a3efa3d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:36.867037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923c634-ba63-49ff-84ff-77cae8f7b47e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:36.869368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 100/199] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:36 2022] GET /identity/v3/users/aaae6a93fa49437faabfb4f26a3efa3d => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:36.870164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923c634-ba63-49ff-84ff-77cae8f7b47e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:36.886623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2198ab-b5a3-4007-ac50-329aa91c0f6a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:36.938248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2e5b9-5d56-4cb3-8178-2857610f11dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:36.938888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e5b9-5d56-4cb3-8178-2857610f11dc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:36.939432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e5b9-5d56-4cb3-8178-2857610f11dc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:36.940048 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e5b9-5d56-4cb3-8178-2857610f11dc None admin] PATH_INFO: `/v3/users/42325eab500f4e779e746472031fe2cd` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:36.941378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2e5b9-5d56-4cb3-8178-2857610f11dc None admin] RBAC: Authorizing `identity:get_user(user_id=42325eab500f4e779e746472031fe2cd)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:36.942987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2e5b9-5d56-4cb3-8178-2857610f11dc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:36.944632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 100/200] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:36 2022] GET /identity/v3/users/42325eab500f4e779e746472031fe2cd => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:36.945678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2e5b9-5d56-4cb3-8178-2857610f11dc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:36.987832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:36.995926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923c634-ba63-49ff-84ff-77cae8f7b47e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:37.033774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768db7f-2bba-4c5b-83c3-c02111a11453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:37.034419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768db7f-2bba-4c5b-83c3-c02111a11453 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:37.034753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768db7f-2bba-4c5b-83c3-c02111a11453 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:37.035032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768db7f-2bba-4c5b-83c3-c02111a11453 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:37.036329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768db7f-2bba-4c5b-83c3-c02111a11453 None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:37.037888 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768db7f-2bba-4c5b-83c3-c02111a11453 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:37.045187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 101/201] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:36 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:37.046135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768db7f-2bba-4c5b-83c3-c02111a11453 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:37.049665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2e5b9-5d56-4cb3-8178-2857610f11dc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:37.085360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846959b-dbdb-4728-862f-1d46dec588fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:37.086325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846959b-dbdb-4728-862f-1d46dec588fe None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:37.086815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846959b-dbdb-4728-862f-1d46dec588fe None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:37.087777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846959b-dbdb-4728-862f-1d46dec588fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:37.090679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:37.156365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768db7f-2bba-4c5b-83c3-c02111a11453 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:37.160849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846959b-dbdb-4728-862f-1d46dec588fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:37.162629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846959b-dbdb-4728-862f-1d46dec588fe None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:37.191424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f854b3-62a0-4748-a084-241dc716b790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:37.192065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f854b3-62a0-4748-a084-241dc716b790 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:37.192345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f854b3-62a0-4748-a084-241dc716b790 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:37.192626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f854b3-62a0-4748-a084-241dc716b790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:37.224354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:37.264450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f854b3-62a0-4748-a084-241dc716b790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:37.266950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f854b3-62a0-4748-a084-241dc716b790 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:37.268517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 101/202] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:37.270572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846959b-dbdb-4728-862f-1d46dec588fe None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:37.308439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:37.374542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 102/203] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:37.375528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f854b3-62a0-4748-a084-241dc716b790 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:37.377603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846959b-dbdb-4728-862f-1d46dec588fe None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:37.415297 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e7e8a-d317-4755-bf92-9aabe31b0d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:37.416302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e7e8a-d317-4755-bf92-9aabe31b0d9c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:37.416774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e7e8a-d317-4755-bf92-9aabe31b0d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:37.417208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e7e8a-d317-4755-bf92-9aabe31b0d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:37.418107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e7e8a-d317-4755-bf92-9aabe31b0d9c None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=5e21e073540045728f2ced13ce6d6eea, user.id=42325eab500f4e779e746472031fe2cd) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:37.418588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e7e8a-d317-4755-bf92-9aabe31b0d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:37.420256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e7e8a-d317-4755-bf92-9aabe31b0d9c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:37.426131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 102/204] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:37 2022] GET /identity/v3/role_assignments?user.id=42325eab500f4e779e746472031fe2cd&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=04d1bc62091440e189989e4b973a6627 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:37.427274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e7e8a-d317-4755-bf92-9aabe31b0d9c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:37.442488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:37.484859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f854b3-62a0-4748-a084-241dc716b790 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:37.525129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae41b1b-f4ce-4021-bca3-a22fa38686a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:37.525783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae41b1b-f4ce-4021-bca3-a22fa38686a7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:37.526060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae41b1b-f4ce-4021-bca3-a22fa38686a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:37.526334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae41b1b-f4ce-4021-bca3-a22fa38686a7 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:37.527495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae41b1b-f4ce-4021-bca3-a22fa38686a7 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:37.529045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae41b1b-f4ce-4021-bca3-a22fa38686a7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:37.531660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 103/205] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:37 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:37.537695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae41b1b-f4ce-4021-bca3-a22fa38686a7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:37.539355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:37.543823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e7e8a-d317-4755-bf92-9aabe31b0d9c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:37.581240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ea2d6-4ad9-41c5-ad23-37422fe14179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:37.582463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ea2d6-4ad9-41c5-ad23-37422fe14179 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:37.582967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ea2d6-4ad9-41c5-ad23-37422fe14179 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:37.583494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ea2d6-4ad9-41c5-ad23-37422fe14179 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:37.585172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ea2d6-4ad9-41c5-ad23-37422fe14179 None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:37.588412 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ea2d6-4ad9-41c5-ad23-37422fe14179 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:37.591300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 103/206] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:37 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:37.597532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ea2d6-4ad9-41c5-ad23-37422fe14179 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:37.663706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae41b1b-f4ce-4021-bca3-a22fa38686a7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:37.693295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:37.709314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4409-25a5-4888-a26a-13788c74ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:37.709948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4409-25a5-4888-a26a-13788c74ba37 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:37.710244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4409-25a5-4888-a26a-13788c74ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:37.710478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4409-25a5-4888-a26a-13788c74ba37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:37.711209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4409-25a5-4888-a26a-13788c74ba37 None admin] RBAC: Adding query filter params (role.id=9b25ee87d1f947dcb8683d955a7c467f, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6, user.id=aaae6a93fa49437faabfb4f26a3efa3d) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:37.711517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4409-25a5-4888-a26a-13788c74ba37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:37.713216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4409-25a5-4888-a26a-13788c74ba37 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:37.722775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 104/207] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:37 2022] GET /identity/v3/role_assignments?user.id=aaae6a93fa49437faabfb4f26a3efa3d&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=9b25ee87d1f947dcb8683d955a7c467f => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:37.782348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ea2d6-4ad9-41c5-ad23-37422fe14179 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:37.826073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0b73e-5d28-4bc5-94d2-cf38bb7fd2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:37.826957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0b73e-5d28-4bc5-94d2-cf38bb7fd2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:37.827392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0b73e-5d28-4bc5-94d2-cf38bb7fd2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:37.827806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0b73e-5d28-4bc5-94d2-cf38bb7fd2e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:37.828762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0b73e-5d28-4bc5-94d2-cf38bb7fd2e3 None admin] RBAC: Adding query filter params (role.id=5691b81a7afd45eca087af3298e82784, scope.project.id=5e21e073540045728f2ced13ce6d6eea, user.id=42325eab500f4e779e746472031fe2cd) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:37.829264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0b73e-5d28-4bc5-94d2-cf38bb7fd2e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:37.830863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0b73e-5d28-4bc5-94d2-cf38bb7fd2e3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:37.838781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 104/208] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:37 2022] GET /identity/v3/role_assignments?user.id=42325eab500f4e779e746472031fe2cd&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=5691b81a7afd45eca087af3298e82784 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:38.516068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaaa9e-a36d-47ff-8b17-c4ee11ed2429 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:38.516469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaaa9e-a36d-47ff-8b17-c4ee11ed2429 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:38.516654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaaa9e-a36d-47ff-8b17-c4ee11ed2429 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:38.518223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 105/209] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:38.523445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a94ee6-02e6-4393-81b7-47d551e43b9b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:38.523911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a94ee6-02e6-4393-81b7-47d551e43b9b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:38.524179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a94ee6-02e6-4393-81b7-47d551e43b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:38.543761 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f2a94ee6-02e6-4393-81b7-47d551e43b9b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:38.544977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f2a94ee6-02e6-4393-81b7-47d551e43b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:38.572419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:38.598323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ecc52-1261-446a-b3d4-5bc02c13120d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:38.598626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ecc52-1261-446a-b3d4-5bc02c13120d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:38.598864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ecc52-1261-446a-b3d4-5bc02c13120d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:38.600502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 106/210] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:38.605963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a305167-beb4-4201-ab12-9499523b60f8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:38.606187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a305167-beb4-4201-ab12-9499523b60f8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:38.606427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a305167-beb4-4201-ab12-9499523b60f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:38.625719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3a305167-beb4-4201-ab12-9499523b60f8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:38.626000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 105/211] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:38.627518 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3a305167-beb4-4201-ab12-9499523b60f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:38.693582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 107/212] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:38.912328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a94ee6-02e6-4393-81b7-47d551e43b9b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:38.959392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a305167-beb4-4201-ab12-9499523b60f8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:39.024614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a94ee6-02e6-4393-81b7-47d551e43b9b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:39.060341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5318482-cc4c-4395-8439-2f068765545c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:39.061076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5318482-cc4c-4395-8439-2f068765545c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:39.061465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5318482-cc4c-4395-8439-2f068765545c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:39.061743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5318482-cc4c-4395-8439-2f068765545c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:39.062861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5318482-cc4c-4395-8439-2f068765545c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:39.064233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a305167-beb4-4201-ab12-9499523b60f8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:39.064355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5318482-cc4c-4395-8439-2f068765545c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:39.066383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 106/213] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:39.072208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5318482-cc4c-4395-8439-2f068765545c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:39.089115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:39.100080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a1d2f-61b3-4551-96db-14bef6ad502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:39.100647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a1d2f-61b3-4551-96db-14bef6ad502a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:39.100917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a1d2f-61b3-4551-96db-14bef6ad502a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:39.101180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a1d2f-61b3-4551-96db-14bef6ad502a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:39.102535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:39.112223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a1d2f-61b3-4551-96db-14bef6ad502a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-719a1d2f-61b3-4551-96db-14bef6ad502a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:39.117364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:39.126277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 108/214] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:39.128251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a1d2f-61b3-4551-96db-14bef6ad502a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:39.177016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5318482-cc4c-4395-8439-2f068765545c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:39.213317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd8ca-87f3-4477-a372-1b74766cdfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:39.213936 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd8ca-87f3-4477-a372-1b74766cdfa4 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:39.214212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd8ca-87f3-4477-a372-1b74766cdfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:39.214481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd8ca-87f3-4477-a372-1b74766cdfa4 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:39.215136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dd8ca-87f3-4477-a372-1b74766cdfa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:39.216624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dd8ca-87f3-4477-a372-1b74766cdfa4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:39.228501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a1d2f-61b3-4551-96db-14bef6ad502a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:39.265760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dcd71-396f-4699-bc1f-fa748692eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:39.266368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dcd71-396f-4699-bc1f-fa748692eb8f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:39.266640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dcd71-396f-4699-bc1f-fa748692eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:39.266905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dcd71-396f-4699-bc1f-fa748692eb8f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:39.267554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dcd71-396f-4699-bc1f-fa748692eb8f None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:39.267850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dcd71-396f-4699-bc1f-fa748692eb8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:39.269303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dcd71-396f-4699-bc1f-fa748692eb8f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:39.279596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 109/215] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:39.283082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dcd71-396f-4699-bc1f-fa748692eb8f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:39.310007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 107/216] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:12:39 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:12:39.353784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:39.420433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dcd71-396f-4699-bc1f-fa748692eb8f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:39.459601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b8232-ca01-4f43-8ae4-c0c8703de2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:39.460576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b8232-ca01-4f43-8ae4-c0c8703de2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:39.461027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b8232-ca01-4f43-8ae4-c0c8703de2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:39.461484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b8232-ca01-4f43-8ae4-c0c8703de2a6 None admin] PATH_INFO: `/v3/users/5224e7ef3b02472da71922cfdb9ae919` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:39.475739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b8232-ca01-4f43-8ae4-c0c8703de2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=5224e7ef3b02472da71922cfdb9ae919)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:39.478184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b8232-ca01-4f43-8ae4-c0c8703de2a6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:39.480152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 110/217] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:39 2022] GET /identity/v3/users/5224e7ef3b02472da71922cfdb9ae919 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:39.485989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd8ca-87f3-4477-a372-1b74766cdfa4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:39.580898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:39.597056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd8ca-87f3-4477-a372-1b74766cdfa4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:39.634386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64efc4-9a41-459e-b8a2-88e6ada03223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:39.635479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64efc4-9a41-459e-b8a2-88e6ada03223 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:39.635766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64efc4-9a41-459e-b8a2-88e6ada03223 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:39.637127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64efc4-9a41-459e-b8a2-88e6ada03223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:39.673029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36317808-9378-4682-9214-607c751e5ef9 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:39.673305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36317808-9378-4682-9214-607c751e5ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:39.673582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36317808-9378-4682-9214-607c751e5ef9 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:39.675065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 111/218] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:12:39.680497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0035e-53c2-467a-beb6-9af8e1e7e7fb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:39.680778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0035e-53c2-467a-beb6-9af8e1e7e7fb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:39.681653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0035e-53c2-467a-beb6-9af8e1e7e7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:39.715225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64efc4-9a41-459e-b8a2-88e6ada03223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:39.717379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0ec0035e-53c2-467a-beb6-9af8e1e7e7fb None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:39.717822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64efc4-9a41-459e-b8a2-88e6ada03223 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:39.718632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0ec0035e-53c2-467a-beb6-9af8e1e7e7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:39.812809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 112/219] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:39.823933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:39.843136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 108/220] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:39.850618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0035e-53c2-467a-beb6-9af8e1e7e7fb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:39.852546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5243e-78dd-4e89-87e0-6d9eba6cf07b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:39.853392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5243e-78dd-4e89-87e0-6d9eba6cf07b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:39.853668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5243e-78dd-4e89-87e0-6d9eba6cf07b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:39.855436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 109/221] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:12:39.860228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0fff-5a92-43ce-a6ca-083d4e86cbc7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:39.860514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0fff-5a92-43ce-a6ca-083d4e86cbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:39.860795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0fff-5a92-43ce-a6ca-083d4e86cbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:39.879380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5b7d0fff-5a92-43ce-a6ca-083d4e86cbc7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:39.880595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5b7d0fff-5a92-43ce-a6ca-083d4e86cbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:39.922230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:39.964945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 110/222] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:40.028773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0035e-53c2-467a-beb6-9af8e1e7e7fb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:40.077145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c0d89-d9c0-47f4-bc71-407db6a0a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:40.078172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c0d89-d9c0-47f4-bc71-407db6a0a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:40.078654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c0d89-d9c0-47f4-bc71-407db6a0a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:40.079143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c0d89-d9c0-47f4-bc71-407db6a0a1c4 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:40.080486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c0d89-d9c0-47f4-bc71-407db6a0a1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:40.082184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c0d89-d9c0-47f4-bc71-407db6a0a1c4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:40.084052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 113/223] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:39 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:40.090713 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d0fff-5a92-43ce-a6ca-083d4e86cbc7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:40.117901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c0d89-d9c0-47f4-bc71-407db6a0a1c4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:40.249196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c0d89-d9c0-47f4-bc71-407db6a0a1c4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:40.256177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:40.285022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d0fff-5a92-43ce-a6ca-083d4e86cbc7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:40.304585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:40.325484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29364-349b-415f-9506-f70234991fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:40.326129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29364-349b-415f-9506-f70234991fee None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:40.326403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29364-349b-415f-9506-f70234991fee None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:40.326523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72914539-0846-4986-b32e-3f26424a8307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:40.326661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29364-349b-415f-9506-f70234991fee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:40.327187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72914539-0846-4986-b32e-3f26424a8307 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:40.327549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72914539-0846-4986-b32e-3f26424a8307 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:40.327772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72914539-0846-4986-b32e-3f26424a8307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:40.328570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72914539-0846-4986-b32e-3f26424a8307 None admin] RBAC: Adding query filter params (role.id=8941b3ff5a124d0a918ea79de7649945, scope.project.id=5e21e073540045728f2ced13ce6d6eea, user.id=5224e7ef3b02472da71922cfdb9ae919) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:40.328875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72914539-0846-4986-b32e-3f26424a8307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:40.330366 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72914539-0846-4986-b32e-3f26424a8307 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:40.336250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 111/224] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:40 2022] GET /identity/v3/role_assignments?user.id=5224e7ef3b02472da71922cfdb9ae919&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:40.353901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b29364-349b-415f-9506-f70234991fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:40.356181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72914539-0846-4986-b32e-3f26424a8307 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e9b29364-349b-415f-9506-f70234991fee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:40.359165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:40.360138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:40.363971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 114/225] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:12:40.381429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29364-349b-415f-9506-f70234991fee None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:40.476796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72914539-0846-4986-b32e-3f26424a8307 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:40.515026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5ae65-0e45-4409-93d7-bc678a33ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:40.515581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ae65-0e45-4409-93d7-bc678a33ff68 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:40.515855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ae65-0e45-4409-93d7-bc678a33ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:40.516144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ae65-0e45-4409-93d7-bc678a33ff68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:40.528268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5ae65-0e45-4409-93d7-bc678a33ff68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-61e5ae65-0e45-4409-93d7-bc678a33ff68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:40.533795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:40.534857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:40.535737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 112/226] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:12:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:12:40.546683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5ae65-0e45-4409-93d7-bc678a33ff68 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:40.575256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29364-349b-415f-9506-f70234991fee None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:40.605877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:40.640980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773f8a-5948-4450-aaee-245cb92d78b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:40.641892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773f8a-5948-4450-aaee-245cb92d78b3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:40.642310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773f8a-5948-4450-aaee-245cb92d78b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:40.642750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773f8a-5948-4450-aaee-245cb92d78b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:40.643558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7773f8a-5948-4450-aaee-245cb92d78b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:40.645248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7773f8a-5948-4450-aaee-245cb92d78b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:40.646790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7773f8a-5948-4450-aaee-245cb92d78b3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:40.663824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 115/227] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:40.672980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773f8a-5948-4450-aaee-245cb92d78b3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:40.726329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:40.734003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5ae65-0e45-4409-93d7-bc678a33ff68 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:40.804097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de062d-bc6d-43d1-b2aa-ae759832c2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:40.804707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de062d-bc6d-43d1-b2aa-ae759832c2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:40.804980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de062d-bc6d-43d1-b2aa-ae759832c2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:40.805246 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de062d-bc6d-43d1-b2aa-ae759832c2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:40.807405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de062d-bc6d-43d1-b2aa-ae759832c2f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:40.807751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de062d-bc6d-43d1-b2aa-ae759832c2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:40.809168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de062d-bc6d-43d1-b2aa-ae759832c2f1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:40.817690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 113/228] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:12:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:40.829294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de062d-bc6d-43d1-b2aa-ae759832c2f1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:40.902014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773f8a-5948-4450-aaee-245cb92d78b3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:40.934925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:40.938119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de062d-bc6d-43d1-b2aa-ae759832c2f1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:40.971746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2a948-c9c1-4d3e-981b-f376ef7fa4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:40.972566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a948-c9c1-4d3e-981b-f376ef7fa4aa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:40.972863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a948-c9c1-4d3e-981b-f376ef7fa4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:40.973133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a948-c9c1-4d3e-981b-f376ef7fa4aa None admin] PATH_INFO: `/v3/users/42325eab500f4e779e746472031fe2cd` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:40.974446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2a948-c9c1-4d3e-981b-f376ef7fa4aa None admin] RBAC: Authorizing `identity:get_user(user_id=42325eab500f4e779e746472031fe2cd)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:40.976207 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2a948-c9c1-4d3e-981b-f376ef7fa4aa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:40.978478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff3dd7-6c5f-47d6-b5ec-df6b897e9853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:40.978870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 114/229] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:40 2022] GET /identity/v3/users/42325eab500f4e779e746472031fe2cd => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:40.979548 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff3dd7-6c5f-47d6-b5ec-df6b897e9853 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:40.980070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff3dd7-6c5f-47d6-b5ec-df6b897e9853 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:40.980574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff3dd7-6c5f-47d6-b5ec-df6b897e9853 None admin] PATH_INFO: `/v3/users/42325eab500f4e779e746472031fe2cd` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:40.985519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff3dd7-6c5f-47d6-b5ec-df6b897e9853 None admin] RBAC: Authorizing `identity:get_user(user_id=42325eab500f4e779e746472031fe2cd)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:40.987197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff3dd7-6c5f-47d6-b5ec-df6b897e9853 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:40.989280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 116/230] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:40 2022] GET /identity/v3/users/42325eab500f4e779e746472031fe2cd => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:40.992180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2a948-c9c1-4d3e-981b-f376ef7fa4aa None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:40.996277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff3dd7-6c5f-47d6-b5ec-df6b897e9853 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:41.143993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2a948-c9c1-4d3e-981b-f376ef7fa4aa None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:41.174801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:41.189420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff3dd7-6c5f-47d6-b5ec-df6b897e9853 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:41.201632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a2ac1-0eaa-4d06-8d53-97a4a453c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:41.202507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a2ac1-0eaa-4d06-8d53-97a4a453c7ca None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:41.202978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a2ac1-0eaa-4d06-8d53-97a4a453c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:41.203441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a2ac1-0eaa-4d06-8d53-97a4a453c7ca None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:41.204932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a2ac1-0eaa-4d06-8d53-97a4a453c7ca None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:41.206593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a2ac1-0eaa-4d06-8d53-97a4a453c7ca None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:41.210287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 115/231] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:40 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:41.217664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a2ac1-0eaa-4d06-8d53-97a4a453c7ca None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:41.264729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f40ceb-2004-4787-b61f-698d2b2fde10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:41.265373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f40ceb-2004-4787-b61f-698d2b2fde10 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:41.266875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f40ceb-2004-4787-b61f-698d2b2fde10 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:41.267151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f40ceb-2004-4787-b61f-698d2b2fde10 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:41.269028 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f40ceb-2004-4787-b61f-698d2b2fde10 None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:41.270495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f40ceb-2004-4787-b61f-698d2b2fde10 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:41.275489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 117/232] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:40 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:41.276454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:41.282646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f40ceb-2004-4787-b61f-698d2b2fde10 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:41.396984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a2ac1-0eaa-4d06-8d53-97a4a453c7ca None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:41.460345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f40ceb-2004-4787-b61f-698d2b2fde10 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:41.463448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e89dee-75c9-4bdd-9e42-f210f5e05beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:41.464148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89dee-75c9-4bdd-9e42-f210f5e05beb None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:41.464426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89dee-75c9-4bdd-9e42-f210f5e05beb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:41.464704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89dee-75c9-4bdd-9e42-f210f5e05beb None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea/users/42325eab500f4e779e746472031fe2cd/roles/5691b81a7afd45eca087af3298e82784` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:41.471630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e89dee-75c9-4bdd-9e42-f210f5e05beb None admin] RBAC: Authorizing `identity:create_grant(project_id=5e21e073540045728f2ced13ce6d6eea, user_id=42325eab500f4e779e746472031fe2cd, role_id=5691b81a7afd45eca087af3298e82784)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:41.473129 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e89dee-75c9-4bdd-9e42-f210f5e05beb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:41.504161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538cc89-d22e-4072-b915-a384b7170599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:41.504824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538cc89-d22e-4072-b915-a384b7170599 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:41.505104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538cc89-d22e-4072-b915-a384b7170599 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:41.505377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538cc89-d22e-4072-b915-a384b7170599 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea/users/42325eab500f4e779e746472031fe2cd/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:41.507471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538cc89-d22e-4072-b915-a384b7170599 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e21e073540045728f2ced13ce6d6eea, user_id=42325eab500f4e779e746472031fe2cd, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:41.509191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538cc89-d22e-4072-b915-a384b7170599 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:41.550804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 116/233] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:12:41 2022] PUT /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea/users/42325eab500f4e779e746472031fe2cd/roles/5691b81a7afd45eca087af3298e82784 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:12:41.631563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 118/234] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:12:41 2022] PUT /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea/users/42325eab500f4e779e746472031fe2cd/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:12:41.710469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1fe0-7b79-4a67-ace7-a90478efc0f7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:41.710961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1fe0-7b79-4a67-ace7-a90478efc0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:41.710961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1fe0-7b79-4a67-ace7-a90478efc0f7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:41.713125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 117/235] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:41.718966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ea255-712e-4383-a6fb-58aba74e798b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:41.719284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ea255-712e-4383-a6fb-58aba74e798b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:41.719515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ea255-712e-4383-a6fb-58aba74e798b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:41.739390 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-207ea255-712e-4383-a6fb-58aba74e798b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:41.740630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-207ea255-712e-4383-a6fb-58aba74e798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:41.759714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:41.822547 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 119/236] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:41.841105 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd574b-b57f-44ce-bbce-aad66968a886 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:41.841388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd574b-b57f-44ce-bbce-aad66968a886 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:41.841662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd574b-b57f-44ce-bbce-aad66968a886 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:41.843170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 118/237] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:41.848814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819a597-1668-42e4-bbd0-e0dd89bf2a46 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:41.849363 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819a597-1668-42e4-bbd0-e0dd89bf2a46 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:41.849846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819a597-1668-42e4-bbd0-e0dd89bf2a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:41.868949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7819a597-1668-42e4-bbd0-e0dd89bf2a46 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:41.870642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7819a597-1668-42e4-bbd0-e0dd89bf2a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:41.940796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 120/238] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:42.176124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd574b-b57f-44ce-bbce-aad66968a886 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:42.214741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819a597-1668-42e4-bbd0-e0dd89bf2a46 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:42.342596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:42.355855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd574b-b57f-44ce-bbce-aad66968a886 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:42.365294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:42.399274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819a597-1668-42e4-bbd0-e0dd89bf2a46 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:42.436656 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa189b-4044-49fe-925c-9926010b7241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:42.436952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6aa996-24f4-4a55-922a-fb32d36558dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:42.437624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aa996-24f4-4a55-922a-fb32d36558dd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:42.437908 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aa996-24f4-4a55-922a-fb32d36558dd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:42.438175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aa996-24f4-4a55-922a-fb32d36558dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:42.438459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa189b-4044-49fe-925c-9926010b7241 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:42.438926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa189b-4044-49fe-925c-9926010b7241 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:42.439393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa189b-4044-49fe-925c-9926010b7241 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:42.441257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa189b-4044-49fe-925c-9926010b7241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:42.443671 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa189b-4044-49fe-925c-9926010b7241 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:42.444071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 119/239] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:42.454806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6aa996-24f4-4a55-922a-fb32d36558dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:42.465678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa189b-4044-49fe-925c-9926010b7241 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8d6aa996-24f4-4a55-922a-fb32d36558dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:42.465801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:42.466608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:42.467373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 121/240] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:12:42.469609 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6aa996-24f4-4a55-922a-fb32d36558dd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:42.615122 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa189b-4044-49fe-925c-9926010b7241 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:42.667799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6aa996-24f4-4a55-922a-fb32d36558dd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:42.684500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86763071-b110-47e6-9905-61817ba8273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:42.685478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86763071-b110-47e6-9905-61817ba8273f None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:42.685922 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86763071-b110-47e6-9905-61817ba8273f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:42.686355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86763071-b110-47e6-9905-61817ba8273f None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:42.687479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86763071-b110-47e6-9905-61817ba8273f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:42.689117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86763071-b110-47e6-9905-61817ba8273f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:42.703561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8ee21-b21e-47d3-b62b-6b2bed1464b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:42.704283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8ee21-b21e-47d3-b62b-6b2bed1464b6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:42.704620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8ee21-b21e-47d3-b62b-6b2bed1464b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:42.705046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8ee21-b21e-47d3-b62b-6b2bed1464b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:42.705805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8ee21-b21e-47d3-b62b-6b2bed1464b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:42.706342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8ee21-b21e-47d3-b62b-6b2bed1464b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:42.707847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8ee21-b21e-47d3-b62b-6b2bed1464b6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:42.717150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 122/241] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:42.718293 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9462e-b234-4d60-9e26-bc2d3df9098a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:42.722918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9462e-b234-4d60-9e26-bc2d3df9098a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:42.723214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9462e-b234-4d60-9e26-bc2d3df9098a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:42.728923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 123/242] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:42.728923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9462e-b234-4d60-9e26-bc2d3df9098a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:42.729806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:42.767309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 120/243] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:12:42 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:42.769346 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48812ae-86fc-4321-bdb5-ed5f7607fe98 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:42.769880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48812ae-86fc-4321-bdb5-ed5f7607fe98 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:42.770422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48812ae-86fc-4321-bdb5-ed5f7607fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:42.805713 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c48812ae-86fc-4321-bdb5-ed5f7607fe98 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:42.807098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c48812ae-86fc-4321-bdb5-ed5f7607fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:42.830043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:42.901936 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 121/244] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:42.921188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9462e-b234-4d60-9e26-bc2d3df9098a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:42.958073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d636d-1b33-4c57-9a4a-ec3fd006a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:42.958723 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d636d-1b33-4c57-9a4a-ec3fd006a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:42.959000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d636d-1b33-4c57-9a4a-ec3fd006a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:42.959266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d636d-1b33-4c57-9a4a-ec3fd006a4a8 None admin] PATH_INFO: `/v3/users/5abdb0c9d77f48b6aff052dc47c1a5dd` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:42.975737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d636d-1b33-4c57-9a4a-ec3fd006a4a8 None admin] RBAC: Authorizing `identity:get_user(user_id=5abdb0c9d77f48b6aff052dc47c1a5dd)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:42.977252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d636d-1b33-4c57-9a4a-ec3fd006a4a8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:42.979553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 124/245] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:42 2022] GET /identity/v3/users/5abdb0c9d77f48b6aff052dc47c1a5dd => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:42.985391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48812ae-86fc-4321-bdb5-ed5f7607fe98 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:43.091385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48812ae-86fc-4321-bdb5-ed5f7607fe98 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:43.129360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcfd47-0f31-4680-8ce0-f5c33153efe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:43.129962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfd47-0f31-4680-8ce0-f5c33153efe0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:43.130305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfd47-0f31-4680-8ce0-f5c33153efe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:43.130573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfd47-0f31-4680-8ce0-f5c33153efe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:43.150947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:43.200474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcfd47-0f31-4680-8ce0-f5c33153efe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:43.201954 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcfd47-0f31-4680-8ce0-f5c33153efe0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:43.227823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d636d-1b33-4c57-9a4a-ec3fd006a4a8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:43.315567 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:43.331116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 122/246] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:43.338974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcfd47-0f31-4680-8ce0-f5c33153efe0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:43.372381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d636d-1b33-4c57-9a4a-ec3fd006a4a8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:43.408269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:43.416992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2c2cb-5ab4-4963-8a65-289570383b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:43.418240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c2cb-5ab4-4963-8a65-289570383b8e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:43.418710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c2cb-5ab4-4963-8a65-289570383b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:43.419282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c2cb-5ab4-4963-8a65-289570383b8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:43.433850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2c2cb-5ab4-4963-8a65-289570383b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6fe2c2cb-5ab4-4963-8a65-289570383b8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:43.440266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:43.441155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:43.441943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:43.444830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 125/247] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:12:43.450727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2c2cb-5ab4-4963-8a65-289570383b8e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:43.470455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcfd47-0f31-4680-8ce0-f5c33153efe0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:43.509008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1662a43-4343-4ced-9cff-976acbf690e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:43.509689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1662a43-4343-4ced-9cff-976acbf690e4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:43.510031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1662a43-4343-4ced-9cff-976acbf690e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:43.510750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1662a43-4343-4ced-9cff-976acbf690e4 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:43.511598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1662a43-4343-4ced-9cff-976acbf690e4 None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:43.513230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1662a43-4343-4ced-9cff-976acbf690e4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:43.515144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 123/248] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:43 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:43.521683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1662a43-4343-4ced-9cff-976acbf690e4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:43.562135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2c2cb-5ab4-4963-8a65-289570383b8e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:43.583316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:43.598377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411461b-1394-49ec-9685-82090f8f0ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:43.599292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411461b-1394-49ec-9685-82090f8f0ada None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:43.599730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411461b-1394-49ec-9685-82090f8f0ada None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:43.600762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411461b-1394-49ec-9685-82090f8f0ada None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:43.601335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411461b-1394-49ec-9685-82090f8f0ada None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:43.601833 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411461b-1394-49ec-9685-82090f8f0ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:43.604074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411461b-1394-49ec-9685-82090f8f0ada None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:43.614102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 126/249] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:43.620142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411461b-1394-49ec-9685-82090f8f0ada None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:43.633860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1662a43-4343-4ced-9cff-976acbf690e4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:43.653933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:43.673776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17031a42-89e2-4468-9d8f-594ec96d7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:43.674390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17031a42-89e2-4468-9d8f-594ec96d7bba None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:43.674663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17031a42-89e2-4468-9d8f-594ec96d7bba None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:43.674993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17031a42-89e2-4468-9d8f-594ec96d7bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:43.675824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17031a42-89e2-4468-9d8f-594ec96d7bba None admin] RBAC: Adding query filter params (role.id=9b25ee87d1f947dcb8683d955a7c467f, scope.project.id=5e21e073540045728f2ced13ce6d6eea, user.id=5abdb0c9d77f48b6aff052dc47c1a5dd) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:43.676191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17031a42-89e2-4468-9d8f-594ec96d7bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:43.677738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17031a42-89e2-4468-9d8f-594ec96d7bba None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:43.684284 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 124/250] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:43 2022] GET /identity/v3/role_assignments?user.id=5abdb0c9d77f48b6aff052dc47c1a5dd&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=9b25ee87d1f947dcb8683d955a7c467f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:43.736729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411461b-1394-49ec-9685-82090f8f0ada None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:43.775356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db29561-c5f5-4212-821a-93eddf6809a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:43.776376 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29561-c5f5-4212-821a-93eddf6809a3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:43.776854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29561-c5f5-4212-821a-93eddf6809a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:43.777320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29561-c5f5-4212-821a-93eddf6809a3 None admin] PATH_INFO: `/v3/users/5224e7ef3b02472da71922cfdb9ae919` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:43.778812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db29561-c5f5-4212-821a-93eddf6809a3 None admin] RBAC: Authorizing `identity:get_user(user_id=5224e7ef3b02472da71922cfdb9ae919)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:43.780558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db29561-c5f5-4212-821a-93eddf6809a3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:43.782553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 127/251] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:43 2022] GET /identity/v3/users/5224e7ef3b02472da71922cfdb9ae919 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:43.788472 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17031a42-89e2-4468-9d8f-594ec96d7bba None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:43.887864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ec56f-981b-4cf6-b2f2-e8fcdea5a129 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:43.888426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ec56f-981b-4cf6-b2f2-e8fcdea5a129 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:43.888840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ec56f-981b-4cf6-b2f2-e8fcdea5a129 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:43.890673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 128/252] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:43.895955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a100e3-4eb6-43c7-ab44-839133477834 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:43.896520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a100e3-4eb6-43c7-ab44-839133477834 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:43.897022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a100e3-4eb6-43c7-ab44-839133477834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:43.923221 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17031a42-89e2-4468-9d8f-594ec96d7bba None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:43.937007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-72a100e3-4eb6-43c7-ab44-839133477834 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:43.938858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-72a100e3-4eb6-43c7-ab44-839133477834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:43.976659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12544e87-e7ce-4984-8af0-7f1ffd4a9c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:43.977318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12544e87-e7ce-4984-8af0-7f1ffd4a9c44 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:43.977576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12544e87-e7ce-4984-8af0-7f1ffd4a9c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:43.977877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12544e87-e7ce-4984-8af0-7f1ffd4a9c44 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:43.979076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12544e87-e7ce-4984-8af0-7f1ffd4a9c44 None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:43.980589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12544e87-e7ce-4984-8af0-7f1ffd4a9c44 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:43.987281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 125/253] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:43 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:43.991934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12544e87-e7ce-4984-8af0-7f1ffd4a9c44 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:44.018916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:44.033913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 129/254] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:44.057402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59978df-2291-4136-8049-69733a8db0ed None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:44.058273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59978df-2291-4136-8049-69733a8db0ed None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:44.058504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59978df-2291-4136-8049-69733a8db0ed None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:44.060387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 130/255] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:44.075199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5e356-7003-436c-9b6a-2227ec94f124 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:44.075809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5e356-7003-436c-9b6a-2227ec94f124 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:44.076351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5e356-7003-436c-9b6a-2227ec94f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:44.098600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:44.100323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bff5e356-7003-436c-9b6a-2227ec94f124 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:44.102891 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bff5e356-7003-436c-9b6a-2227ec94f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:44.179975 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 131/256] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:44.210006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12544e87-e7ce-4984-8af0-7f1ffd4a9c44 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:44.260724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6f8c-3f07-4cfd-a7a8-54cd1008a750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:44.261391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6f8c-3f07-4cfd-a7a8-54cd1008a750 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:44.261674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6f8c-3f07-4cfd-a7a8-54cd1008a750 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:44.261947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6f8c-3f07-4cfd-a7a8-54cd1008a750 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea/users/5224e7ef3b02472da71922cfdb9ae919/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:44.263899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6f8c-3f07-4cfd-a7a8-54cd1008a750 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e21e073540045728f2ced13ce6d6eea, user_id=5224e7ef3b02472da71922cfdb9ae919, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:44.265358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6f8c-3f07-4cfd-a7a8-54cd1008a750 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:44.338277 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 126/257] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:12:43 2022] PUT /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea/users/5224e7ef3b02472da71922cfdb9ae919/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:12:44.420476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5e356-7003-436c-9b6a-2227ec94f124 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:44.490687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6f8c-3f07-4cfd-a7a8-54cd1008a750 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:44.566569 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5e356-7003-436c-9b6a-2227ec94f124 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:44.582679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:44.615728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e36fd-c1d0-48ae-81c2-5eef81d90f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:44.617590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e36fd-c1d0-48ae-81c2-5eef81d90f9b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:44.617890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e36fd-c1d0-48ae-81c2-5eef81d90f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:44.618129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e36fd-c1d0-48ae-81c2-5eef81d90f9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:44.634979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6f8c-3f07-4cfd-a7a8-54cd1008a750 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:44.644859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e36fd-c1d0-48ae-81c2-5eef81d90f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8a7e36fd-c1d0-48ae-81c2-5eef81d90f9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:44.650575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:44.651435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:44.652269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 132/258] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:12:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:44.657504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:44.658733 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e36fd-c1d0-48ae-81c2-5eef81d90f9b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:44.700882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9b170-6739-4038-ba84-cc779d976bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:44.701519 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b170-6739-4038-ba84-cc779d976bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:44.701795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b170-6739-4038-ba84-cc779d976bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:44.704754 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b170-6739-4038-ba84-cc779d976bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:44.725315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9b170-6739-4038-ba84-cc779d976bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f1c9b170-6739-4038-ba84-cc779d976bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:44.737485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:44.738357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:44.739381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 127/259] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:12:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:44.754308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9b170-6739-4038-ba84-cc779d976bd6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:44.862474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e36fd-c1d0-48ae-81c2-5eef81d90f9b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:44.926486 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9b170-6739-4038-ba84-cc779d976bd6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:44.930216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d7734-aaab-4d9b-af98-72713c2123e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:44.931066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d7734-aaab-4d9b-af98-72713c2123e9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:44.931622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d7734-aaab-4d9b-af98-72713c2123e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:44.932643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d7734-aaab-4d9b-af98-72713c2123e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:44.933642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d7734-aaab-4d9b-af98-72713c2123e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:44.935346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d7734-aaab-4d9b-af98-72713c2123e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:44.936906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d7734-aaab-4d9b-af98-72713c2123e9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:44.951373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 133/260] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:12:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:44.957066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d7734-aaab-4d9b-af98-72713c2123e9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:44.994960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903d56a-bfa6-49f0-a23a-73c1fece93c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:44.997579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903d56a-bfa6-49f0-a23a-73c1fece93c5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:44.998946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903d56a-bfa6-49f0-a23a-73c1fece93c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:44.999374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903d56a-bfa6-49f0-a23a-73c1fece93c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:45.000198 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903d56a-bfa6-49f0-a23a-73c1fece93c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:45.000830 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903d56a-bfa6-49f0-a23a-73c1fece93c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:45.003466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903d56a-bfa6-49f0-a23a-73c1fece93c5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:45.017470 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:45.023213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 128/261] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:45.028752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903d56a-bfa6-49f0-a23a-73c1fece93c5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:45.088517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:45.125662 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d7734-aaab-4d9b-af98-72713c2123e9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:45.202116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93608d1c-6a01-47fa-8eed-5fe439a9e45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:45.203145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93608d1c-6a01-47fa-8eed-5fe439a9e45f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:45.204292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93608d1c-6a01-47fa-8eed-5fe439a9e45f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:45.204577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93608d1c-6a01-47fa-8eed-5fe439a9e45f None admin] PATH_INFO: `/v3/users/42325eab500f4e779e746472031fe2cd` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:45.205842 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93608d1c-6a01-47fa-8eed-5fe439a9e45f None admin] RBAC: Authorizing `identity:get_user(user_id=42325eab500f4e779e746472031fe2cd)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:45.207289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93608d1c-6a01-47fa-8eed-5fe439a9e45f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:45.208935 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 134/262] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:44 2022] GET /identity/v3/users/42325eab500f4e779e746472031fe2cd => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:45.214654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93608d1c-6a01-47fa-8eed-5fe439a9e45f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:45.218429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903d56a-bfa6-49f0-a23a-73c1fece93c5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:45.300689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9924-c7bc-4aef-9391-58cdb5228f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:45.301332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9924-c7bc-4aef-9391-58cdb5228f3b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:45.301605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9924-c7bc-4aef-9391-58cdb5228f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:45.301875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9924-c7bc-4aef-9391-58cdb5228f3b None admin] PATH_INFO: `/v3/users/42325eab500f4e779e746472031fe2cd` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:45.303795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9924-c7bc-4aef-9391-58cdb5228f3b None admin] RBAC: Authorizing `identity:get_user(user_id=42325eab500f4e779e746472031fe2cd)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:45.305400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9924-c7bc-4aef-9391-58cdb5228f3b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:45.307715 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 129/263] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:45 2022] GET /identity/v3/users/42325eab500f4e779e746472031fe2cd => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:45.315480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9924-c7bc-4aef-9391-58cdb5228f3b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:45.380849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:45.390874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93608d1c-6a01-47fa-8eed-5fe439a9e45f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:45.456701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eaa0a-7231-40e8-9224-093f0b00499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:45.457286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eaa0a-7231-40e8-9224-093f0b00499a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:45.457572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eaa0a-7231-40e8-9224-093f0b00499a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:45.457852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eaa0a-7231-40e8-9224-093f0b00499a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:45.566331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:45.574579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9924-c7bc-4aef-9391-58cdb5228f3b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:45.580875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eaa0a-7231-40e8-9224-093f0b00499a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:45.582357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eaa0a-7231-40e8-9224-093f0b00499a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:45.666005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aeaeb-0a00-442c-bc1d-1b0614a498f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:45.666622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aeaeb-0a00-442c-bc1d-1b0614a498f5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:45.666899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aeaeb-0a00-442c-bc1d-1b0614a498f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:45.667171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aeaeb-0a00-442c-bc1d-1b0614a498f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:45.788976 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:45.793777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 135/264] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 09:12:45.799226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eaa0a-7231-40e8-9224-093f0b00499a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:45.837012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89aeaeb-0a00-442c-bc1d-1b0614a498f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:45.839051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89aeaeb-0a00-442c-bc1d-1b0614a498f5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:46.010620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eaa0a-7231-40e8-9224-093f0b00499a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:46.077779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd759e7-f267-4329-8dcf-dd70ae536286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:46.078356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd759e7-f267-4329-8dcf-dd70ae536286 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:46.078640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd759e7-f267-4329-8dcf-dd70ae536286 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:46.078917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd759e7-f267-4329-8dcf-dd70ae536286 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:46.084637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd759e7-f267-4329-8dcf-dd70ae536286 None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:46.086135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd759e7-f267-4329-8dcf-dd70ae536286 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:46.088739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 136/265] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:45 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:46.093047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:46.094165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd759e7-f267-4329-8dcf-dd70ae536286 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:46.103598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 130/266] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 09:12:46.109165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aeaeb-0a00-442c-bc1d-1b0614a498f5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:46.192420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:46.245997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd759e7-f267-4329-8dcf-dd70ae536286 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:46.325507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d48f6-fd3e-4db9-8ff2-1e91bbe7240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:46.326121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d48f6-fd3e-4db9-8ff2-1e91bbe7240f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:46.326393 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d48f6-fd3e-4db9-8ff2-1e91bbe7240f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:46.326660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d48f6-fd3e-4db9-8ff2-1e91bbe7240f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:46.327384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d48f6-fd3e-4db9-8ff2-1e91bbe7240f None admin] RBAC: Adding query filter params (role.id=5691b81a7afd45eca087af3298e82784, scope.project.id=5e21e073540045728f2ced13ce6d6eea, user.id=42325eab500f4e779e746472031fe2cd) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:46.327684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d48f6-fd3e-4db9-8ff2-1e91bbe7240f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:46.329199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d48f6-fd3e-4db9-8ff2-1e91bbe7240f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:46.339809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 137/267] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:46 2022] GET /identity/v3/role_assignments?user.id=42325eab500f4e779e746472031fe2cd&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=5691b81a7afd45eca087af3298e82784 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:46.345240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac6a5-16ad-4525-8e43-74e8efc2df4f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:46.345516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac6a5-16ad-4525-8e43-74e8efc2df4f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:46.345790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac6a5-16ad-4525-8e43-74e8efc2df4f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:46.347064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 138/268] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:46.358359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aeaeb-0a00-442c-bc1d-1b0614a498f5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:46.369871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdebbbb-20d3-4044-9014-fe057642e356 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:46.370199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdebbbb-20d3-4044-9014-fe057642e356 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:46.370397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdebbbb-20d3-4044-9014-fe057642e356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:46.409098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bcdebbbb-20d3-4044-9014-fe057642e356 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:46.410289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bcdebbbb-20d3-4044-9014-fe057642e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:46.431418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ee2a6-b605-4160-adfb-19dce15b7513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:46.432461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ee2a6-b605-4160-adfb-19dce15b7513 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:46.432746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ee2a6-b605-4160-adfb-19dce15b7513 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:46.433025 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ee2a6-b605-4160-adfb-19dce15b7513 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:46.436742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ee2a6-b605-4160-adfb-19dce15b7513 None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:46.438643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ee2a6-b605-4160-adfb-19dce15b7513 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:46.440993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 131/269] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:46 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:46.457360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ee2a6-b605-4160-adfb-19dce15b7513 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:46.560621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 139/270] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:46.562675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d53a-876f-45f8-a725-f789ef936fb5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:46.563162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d53a-876f-45f8-a725-f789ef936fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:46.563627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d53a-876f-45f8-a725-f789ef936fb5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:46.569402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 140/271] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:46.572614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5eef-33d3-47ca-a0d9-ac1b57588a94 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:46.573323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5eef-33d3-47ca-a0d9-ac1b57588a94 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:46.573798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5eef-33d3-47ca-a0d9-ac1b57588a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:46.595267 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-539c5eef-33d3-47ca-a0d9-ac1b57588a94 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:46.597610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:46.598498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-539c5eef-33d3-47ca-a0d9-ac1b57588a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:46.644575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ee2a6-b605-4160-adfb-19dce15b7513 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:46.677090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:46.682389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7010070-9a1f-47bc-b1a5-b5ab42006d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:46.683053 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010070-9a1f-47bc-b1a5-b5ab42006d10 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:46.683422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010070-9a1f-47bc-b1a5-b5ab42006d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:46.683590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010070-9a1f-47bc-b1a5-b5ab42006d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:46.684363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7010070-9a1f-47bc-b1a5-b5ab42006d10 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=5e21e073540045728f2ced13ce6d6eea, user.id=42325eab500f4e779e746472031fe2cd) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:46.684668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7010070-9a1f-47bc-b1a5-b5ab42006d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:46.686368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7010070-9a1f-47bc-b1a5-b5ab42006d10 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:46.698432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 132/273] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:46 2022] GET /identity/v3/role_assignments?user.id=42325eab500f4e779e746472031fe2cd&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=04d1bc62091440e189989e4b973a6627 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:46.698432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158954c2-4e1a-48b0-8d8d-01978e66340f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:46.698432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158954c2-4e1a-48b0-8d8d-01978e66340f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:46.698432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158954c2-4e1a-48b0-8d8d-01978e66340f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:46.698432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 133/274] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:46.699081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 141/274] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:46.704242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69134-1061-4a89-9367-328d47441955 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:46.704540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69134-1061-4a89-9367-328d47441955 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:46.704800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69134-1061-4a89-9367-328d47441955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:46.725170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a2b69134-1061-4a89-9367-328d47441955 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:46.726446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a2b69134-1061-4a89-9367-328d47441955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:46.837496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 134/275] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:46.919117 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5eef-33d3-47ca-a0d9-ac1b57588a94 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.019610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69134-1061-4a89-9367-328d47441955 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.032841 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5eef-33d3-47ca-a0d9-ac1b57588a94 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:47.069934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb24b8-69ac-4059-bd28-26e942fef3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:47.070565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb24b8-69ac-4059-bd28-26e942fef3df None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.070845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb24b8-69ac-4059-bd28-26e942fef3df None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.071218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb24b8-69ac-4059-bd28-26e942fef3df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.072382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb24b8-69ac-4059-bd28-26e942fef3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:47.073994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb24b8-69ac-4059-bd28-26e942fef3df None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:47.075985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 142/276] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:47.081443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb24b8-69ac-4059-bd28-26e942fef3df None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.094560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:47.145563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69134-1061-4a89-9367-328d47441955 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:47.155050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:47.191021 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410ed70-afbb-416f-a90f-6e463f009ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:47.191935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410ed70-afbb-416f-a90f-6e463f009ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.192220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410ed70-afbb-416f-a90f-6e463f009ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.192506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410ed70-afbb-416f-a90f-6e463f009ed0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.200417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb24b8-69ac-4059-bd28-26e942fef3df None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:47.203615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410ed70-afbb-416f-a90f-6e463f009ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7410ed70-afbb-416f-a90f-6e463f009ed0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:47.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:47.209426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:47.210306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 135/277] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:47.211045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670ac56-3e2a-4125-87cf-7a4164e93ee0 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.211045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670ac56-3e2a-4125-87cf-7a4164e93ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.211522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670ac56-3e2a-4125-87cf-7a4164e93ee0 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.216013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 136/278] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:47.216013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670ac56-3e2a-4125-87cf-7a4164e93ee0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.237172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea68d-82b7-412a-9103-eac0b60c9b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:47.237774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea68d-82b7-412a-9103-eac0b60c9b5c None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.238044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea68d-82b7-412a-9103-eac0b60c9b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.238310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea68d-82b7-412a-9103-eac0b60c9b5c None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.238952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ea68d-82b7-412a-9103-eac0b60c9b5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:47.240682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ea68d-82b7-412a-9103-eac0b60c9b5c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:47.316989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670ac56-3e2a-4125-87cf-7a4164e93ee0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:47.325820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 143/279] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:12:47 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:47.326720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea68d-82b7-412a-9103-eac0b60c9b5c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.350152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:47.363900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd787bc0-9f12-4ecd-bc35-2a398b260051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:47.364837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd787bc0-9f12-4ecd-bc35-2a398b260051 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.365113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd787bc0-9f12-4ecd-bc35-2a398b260051 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.365380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd787bc0-9f12-4ecd-bc35-2a398b260051 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.377371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd787bc0-9f12-4ecd-bc35-2a398b260051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bd787bc0-9f12-4ecd-bc35-2a398b260051 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:47.382430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:47.385926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 137/280] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:47.386751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831fcd8-ce36-4d7e-a6a4-acc32e491428 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.387496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831fcd8-ce36-4d7e-a6a4-acc32e491428 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.387496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831fcd8-ce36-4d7e-a6a4-acc32e491428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.406554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3831fcd8-ce36-4d7e-a6a4-acc32e491428 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:47.407780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3831fcd8-ce36-4d7e-a6a4-acc32e491428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:47.449307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea68d-82b7-412a-9103-eac0b60c9b5c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:47.468336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:47.482715 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 138/281] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:47.483359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831fcd8-ce36-4d7e-a6a4-acc32e491428 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.487411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9b06c-677a-4317-a63e-9d0ac767d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:47.488127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9b06c-677a-4317-a63e-9d0ac767d47e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.488411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9b06c-677a-4317-a63e-9d0ac767d47e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.488683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9b06c-677a-4317-a63e-9d0ac767d47e None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.489603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9b06c-677a-4317-a63e-9d0ac767d47e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:47.489900 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9b06c-677a-4317-a63e-9d0ac767d47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:47.491269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9b06c-677a-4317-a63e-9d0ac767d47e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:47.501807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 144/282] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:47.508103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9b06c-677a-4317-a63e-9d0ac767d47e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.621603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831fcd8-ce36-4d7e-a6a4-acc32e491428 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:47.637861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9b06c-677a-4317-a63e-9d0ac767d47e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:47.642463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:47.671158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cb173-1d1d-41d1-8af7-d7fbe5256d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:47.672173 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cb173-1d1d-41d1-8af7-d7fbe5256d34 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.672689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cb173-1d1d-41d1-8af7-d7fbe5256d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.673131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cb173-1d1d-41d1-8af7-d7fbe5256d34 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.674288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cb173-1d1d-41d1-8af7-d7fbe5256d34 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:47.674591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cb173-1d1d-41d1-8af7-d7fbe5256d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:47.676803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cb173-1d1d-41d1-8af7-d7fbe5256d34 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:47.685969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e37f11-1916-4e0f-998f-b60c711eef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:47.686615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e37f11-1916-4e0f-998f-b60c711eef77 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.686891 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e37f11-1916-4e0f-998f-b60c711eef77 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.687161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e37f11-1916-4e0f-998f-b60c711eef77 None admin] PATH_INFO: `/v3/users/5abdb0c9d77f48b6aff052dc47c1a5dd` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.690816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 139/283] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:47.691479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e37f11-1916-4e0f-998f-b60c711eef77 None admin] RBAC: Authorizing `identity:get_user(user_id=5abdb0c9d77f48b6aff052dc47c1a5dd)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:47.692989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e37f11-1916-4e0f-998f-b60c711eef77 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:47.694697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 145/284] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:47 2022] GET /identity/v3/users/5abdb0c9d77f48b6aff052dc47c1a5dd => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:47.696283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cb173-1d1d-41d1-8af7-d7fbe5256d34 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.702596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e37f11-1916-4e0f-998f-b60c711eef77 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.771553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:47.804757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cb173-1d1d-41d1-8af7-d7fbe5256d34 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:47.831910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e37f11-1916-4e0f-998f-b60c711eef77 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:47.849061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a64820-ae3e-436e-8557-1d0f051e9e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:47.849315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a64820-ae3e-436e-8557-1d0f051e9e76 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.849610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a64820-ae3e-436e-8557-1d0f051e9e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.849885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a64820-ae3e-436e-8557-1d0f051e9e76 None admin] PATH_INFO: `/v3/users/e0a8ea39e70c4348946d7e79a6e9a53e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.870340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a64820-ae3e-436e-8557-1d0f051e9e76 None admin] RBAC: Authorizing `identity:get_user(user_id=e0a8ea39e70c4348946d7e79a6e9a53e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:47.871850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a64820-ae3e-436e-8557-1d0f051e9e76 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:47.875140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 140/285] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:47 2022] GET /identity/v3/users/e0a8ea39e70c4348946d7e79a6e9a53e => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:47.880077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a64820-ae3e-436e-8557-1d0f051e9e76 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.880714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a5f83-ff44-4135-9a07-5fc18af6cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:47.881358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a5f83-ff44-4135-9a07-5fc18af6cce0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:47.881686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a5f83-ff44-4135-9a07-5fc18af6cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:47.881960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a5f83-ff44-4135-9a07-5fc18af6cce0 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:47.883175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a5f83-ff44-4135-9a07-5fc18af6cce0 None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:47.886356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a5f83-ff44-4135-9a07-5fc18af6cce0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:47.888433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 146/286] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:47 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:47.889419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a5f83-ff44-4135-9a07-5fc18af6cce0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:47.926602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:48.034519 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a64820-ae3e-436e-8557-1d0f051e9e76 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:48.057660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a5f83-ff44-4135-9a07-5fc18af6cce0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:48.080823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:48.085549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b19885-b178-4126-9e7e-823bb5e7c8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:48.086721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b19885-b178-4126-9e7e-823bb5e7c8ca None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:48.087874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b19885-b178-4126-9e7e-823bb5e7c8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:48.088681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b19885-b178-4126-9e7e-823bb5e7c8ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:48.105407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b19885-b178-4126-9e7e-823bb5e7c8ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:48.107165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba6139-8c0e-4946-9268-67cd7a35dafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:48.108187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba6139-8c0e-4946-9268-67cd7a35dafb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:48.108646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba6139-8c0e-4946-9268-67cd7a35dafb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:48.109115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba6139-8c0e-4946-9268-67cd7a35dafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:48.110223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba6139-8c0e-4946-9268-67cd7a35dafb None admin] RBAC: Adding query filter params (role.id=8941b3ff5a124d0a918ea79de7649945, user.id=e0a8ea39e70c4348946d7e79a6e9a53e, scope.system=all) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:48.110737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba6139-8c0e-4946-9268-67cd7a35dafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-74b19885-b178-4126-9e7e-823bb5e7c8ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:48.112611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:48.113450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:48.114474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:48.115061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba6139-8c0e-4946-9268-67cd7a35dafb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:48.117413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 141/287] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:48.118353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b19885-b178-4126-9e7e-823bb5e7c8ca None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:48.128846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 147/288] 10.222.0.55 () {56 vars in 1308 bytes} [Fri Sep 2 09:12:47 2022] GET /identity/v3/role_assignments?user.id=e0a8ea39e70c4348946d7e79a6e9a53e&scope.system=all&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:48.130806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba6139-8c0e-4946-9268-67cd7a35dafb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:48.333922 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:48.343495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b19885-b178-4126-9e7e-823bb5e7c8ca None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:48.347804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba6139-8c0e-4946-9268-67cd7a35dafb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:48.385797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecd471-f29a-49b3-ab8f-f62d2aac31f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:48.386682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecd471-f29a-49b3-ab8f-f62d2aac31f6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:48.387156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecd471-f29a-49b3-ab8f-f62d2aac31f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:48.387592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecd471-f29a-49b3-ab8f-f62d2aac31f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:48.388627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecd471-f29a-49b3-ab8f-f62d2aac31f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:48.389209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecd471-f29a-49b3-ab8f-f62d2aac31f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:48.390851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecd471-f29a-49b3-ab8f-f62d2aac31f6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:48.399749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 148/289] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:48.405405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a6a0-0249-4035-b35a-aa278479540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:48.405682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecd471-f29a-49b3-ab8f-f62d2aac31f6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:48.406495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a6a0-0249-4035-b35a-aa278479540d None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:48.406929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a6a0-0249-4035-b35a-aa278479540d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:48.407319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a6a0-0249-4035-b35a-aa278479540d None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea/users/5abdb0c9d77f48b6aff052dc47c1a5dd/roles/9b25ee87d1f947dcb8683d955a7c467f` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:48.417285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424a6a0-0249-4035-b35a-aa278479540d None admin] RBAC: Authorizing `identity:create_grant(project_id=5e21e073540045728f2ced13ce6d6eea, user_id=5abdb0c9d77f48b6aff052dc47c1a5dd, role_id=9b25ee87d1f947dcb8683d955a7c467f)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:48.419667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424a6a0-0249-4035-b35a-aa278479540d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:48.452616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:48.514085 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecd471-f29a-49b3-ab8f-f62d2aac31f6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:48.531916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 142/290] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:12:48 2022] PUT /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea/users/5abdb0c9d77f48b6aff052dc47c1a5dd/roles/9b25ee87d1f947dcb8683d955a7c467f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:12:48.575542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7df523-dcd7-469a-a4e5-6d4131ffa833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:48.576805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7df523-dcd7-469a-a4e5-6d4131ffa833 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:48.577278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7df523-dcd7-469a-a4e5-6d4131ffa833 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:48.577737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7df523-dcd7-469a-a4e5-6d4131ffa833 None admin] PATH_INFO: `/v3/users/5224e7ef3b02472da71922cfdb9ae919` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:48.580584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7df523-dcd7-469a-a4e5-6d4131ffa833 None admin] RBAC: Authorizing `identity:get_user(user_id=5224e7ef3b02472da71922cfdb9ae919)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:48.582263 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7df523-dcd7-469a-a4e5-6d4131ffa833 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:48.584500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 149/291] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:48 2022] GET /identity/v3/users/5224e7ef3b02472da71922cfdb9ae919 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:48.591679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a6a0-0249-4035-b35a-aa278479540d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:48.769448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a6a0-0249-4035-b35a-aa278479540d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:48.810287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6171-cbc2-46ac-a4d1-6874bfc23665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:48.810909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6171-cbc2-46ac-a4d1-6874bfc23665 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:48.811188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6171-cbc2-46ac-a4d1-6874bfc23665 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:48.811462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6171-cbc2-46ac-a4d1-6874bfc23665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:48.841603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:48.901523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6171-cbc2-46ac-a4d1-6874bfc23665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:48.903052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6171-cbc2-46ac-a4d1-6874bfc23665 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:49.047028 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 143/292] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:49.054878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7df523-dcd7-469a-a4e5-6d4131ffa833 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:49.188857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7df523-dcd7-469a-a4e5-6d4131ffa833 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:49.199176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:49.226136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656bf52-80c4-41ad-a211-ac9354beec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:49.226769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656bf52-80c4-41ad-a211-ac9354beec1a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:49.227179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656bf52-80c4-41ad-a211-ac9354beec1a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:49.227319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656bf52-80c4-41ad-a211-ac9354beec1a None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:49.228541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656bf52-80c4-41ad-a211-ac9354beec1a None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:49.229979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656bf52-80c4-41ad-a211-ac9354beec1a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:49.232638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 150/293] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:49 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:49.238493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6171-cbc2-46ac-a4d1-6874bfc23665 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:49.320044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:49.384993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6171-cbc2-46ac-a4d1-6874bfc23665 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:49.454503 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d248-4edb-45b9-9fbd-dd2ad4da374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:49.455026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d248-4edb-45b9-9fbd-dd2ad4da374e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:49.455304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d248-4edb-45b9-9fbd-dd2ad4da374e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:49.455579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d248-4edb-45b9-9fbd-dd2ad4da374e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:49.456338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3d248-4edb-45b9-9fbd-dd2ad4da374e None admin] RBAC: Adding query filter params (role.id=8941b3ff5a124d0a918ea79de7649945, scope.project.id=5e21e073540045728f2ced13ce6d6eea, user.id=5224e7ef3b02472da71922cfdb9ae919) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:49.456641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3d248-4edb-45b9-9fbd-dd2ad4da374e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:49.458210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3d248-4edb-45b9-9fbd-dd2ad4da374e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:49.468650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 144/294] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:49 2022] GET /identity/v3/role_assignments?user.id=5224e7ef3b02472da71922cfdb9ae919&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:49.799753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5f4f-8591-4255-8d0e-11b2b0e4667c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:49.800205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5f4f-8591-4255-8d0e-11b2b0e4667c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:49.800332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5f4f-8591-4255-8d0e-11b2b0e4667c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:49.801933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 151/295] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:49.808568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8138fd-a974-458c-9ff8-e8a79de1ea5f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:49.808864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8138fd-a974-458c-9ff8-e8a79de1ea5f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:49.809124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8138fd-a974-458c-9ff8-e8a79de1ea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:49.828921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-af8138fd-a974-458c-9ff8-e8a79de1ea5f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:49.830236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-af8138fd-a974-458c-9ff8-e8a79de1ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:49.899458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 145/296] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:50.134951 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185141fc-6ee6-4bf2-b68d-f183959eb295 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:50.135282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185141fc-6ee6-4bf2-b68d-f183959eb295 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:50.135455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185141fc-6ee6-4bf2-b68d-f183959eb295 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:50.137067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 152/297] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:50.142799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cda854-c194-45a7-8664-01bc64af2d0b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:50.143085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cda854-c194-45a7-8664-01bc64af2d0b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:50.143358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cda854-c194-45a7-8664-01bc64af2d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:50.162332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a3cda854-c194-45a7-8664-01bc64af2d0b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:50.163528 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a3cda854-c194-45a7-8664-01bc64af2d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:50.182184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185141fc-6ee6-4bf2-b68d-f183959eb295 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:50.218251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:50.251580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 146/298] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:50.293179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185141fc-6ee6-4bf2-b68d-f183959eb295 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:50.327463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e23950-fc7b-4c32-be49-e1dffb8d0aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:50.328128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e23950-fc7b-4c32-be49-e1dffb8d0aab None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:50.328456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e23950-fc7b-4c32-be49-e1dffb8d0aab None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:50.328730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e23950-fc7b-4c32-be49-e1dffb8d0aab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:50.340413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e23950-fc7b-4c32-be49-e1dffb8d0aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-68e23950-fc7b-4c32-be49-e1dffb8d0aab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:50.346102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:50.347406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:50.348638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 153/299] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:12:50.353888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cda854-c194-45a7-8664-01bc64af2d0b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:50.500906 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cda854-c194-45a7-8664-01bc64af2d0b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:50.533321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e23950-fc7b-4c32-be49-e1dffb8d0aab None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:50.536506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8a38c-d9c8-48e5-b91d-a8646bf04aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:50.537091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a38c-d9c8-48e5-b91d-a8646bf04aea None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:50.537371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a38c-d9c8-48e5-b91d-a8646bf04aea None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:50.537641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a38c-d9c8-48e5-b91d-a8646bf04aea None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:50.538910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8a38c-d9c8-48e5-b91d-a8646bf04aea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:50.538910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8a38c-d9c8-48e5-b91d-a8646bf04aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:50.539975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8a38c-d9c8-48e5-b91d-a8646bf04aea None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:50.549453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 147/300] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:50.555233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8a38c-d9c8-48e5-b91d-a8646bf04aea None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:50.582606 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:50.607428 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:50.665006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e23950-fc7b-4c32-be49-e1dffb8d0aab None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:50.678129 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8a38c-d9c8-48e5-b91d-a8646bf04aea None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:50.703348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ad629-0775-473d-b9fd-3de57fca28ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:50.704233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad629-0775-473d-b9fd-3de57fca28ef None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:50.704583 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad629-0775-473d-b9fd-3de57fca28ef None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:50.704928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad629-0775-473d-b9fd-3de57fca28ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:50.706312 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ad629-0775-473d-b9fd-3de57fca28ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:50.708089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ad629-0775-473d-b9fd-3de57fca28ef None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:50.715181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 154/301] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:50.716177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ad629-0775-473d-b9fd-3de57fca28ef None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:50.716509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb90a-90d7-48d9-97b5-9510b5753857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:50.717394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb90a-90d7-48d9-97b5-9510b5753857 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:50.717841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb90a-90d7-48d9-97b5-9510b5753857 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:50.718279 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb90a-90d7-48d9-97b5-9510b5753857 None admin] PATH_INFO: `/v3/users/0671bb88efed4cff93ffdfd87e048079` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:50.733308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eb90a-90d7-48d9-97b5-9510b5753857 None admin] RBAC: Authorizing `identity:get_user(user_id=0671bb88efed4cff93ffdfd87e048079)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:50.735295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eb90a-90d7-48d9-97b5-9510b5753857 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:50.738037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 148/302] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:50 2022] GET /identity/v3/users/0671bb88efed4cff93ffdfd87e048079 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:50.744244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb90a-90d7-48d9-97b5-9510b5753857 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:50.840213 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ad629-0775-473d-b9fd-3de57fca28ef None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:50.844164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:50.856489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:50.862386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb90a-90d7-48d9-97b5-9510b5753857 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:50.880827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665ef5c-dd18-4252-a0c4-3517495f894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:50.881442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ef5c-dd18-4252-a0c4-3517495f894c None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:50.881717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ef5c-dd18-4252-a0c4-3517495f894c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:50.881989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ef5c-dd18-4252-a0c4-3517495f894c None admin] PATH_INFO: `/v3/groups` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:50.882673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665ef5c-dd18-4252-a0c4-3517495f894c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:50.884097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665ef5c-dd18-4252-a0c4-3517495f894c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:50.904484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e14204-f606-4c4c-a585-5fd88665ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:50.905595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e14204-f606-4c4c-a585-5fd88665ef8e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:50.905595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e14204-f606-4c4c-a585-5fd88665ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:50.905595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e14204-f606-4c4c-a585-5fd88665ef8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:50.906350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e14204-f606-4c4c-a585-5fd88665ef8e None admin] RBAC: Adding query filter params (role.id=9b25ee87d1f947dcb8683d955a7c467f, user.id=0671bb88efed4cff93ffdfd87e048079, scope.system=all) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:50.906654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e14204-f606-4c4c-a585-5fd88665ef8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:50.908116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e14204-f606-4c4c-a585-5fd88665ef8e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:50.913060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 149/303] 10.222.0.55 () {56 vars in 1308 bytes} [Fri Sep 2 09:12:50 2022] GET /identity/v3/role_assignments?user.id=0671bb88efed4cff93ffdfd87e048079&scope.system=all&role.id=9b25ee87d1f947dcb8683d955a7c467f => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:50.915236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a073a-1a48-4241-912f-a353fafa4401 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:50.915563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a073a-1a48-4241-912f-a353fafa4401 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:50.915847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a073a-1a48-4241-912f-a353fafa4401 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:50.917387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 150/304] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:50.922960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df314c5-a752-4aa9-b85b-854e9019e55a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:50.923256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df314c5-a752-4aa9-b85b-854e9019e55a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:50.923722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df314c5-a752-4aa9-b85b-854e9019e55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:50.943216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5df314c5-a752-4aa9-b85b-854e9019e55a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:50.944473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5df314c5-a752-4aa9-b85b-854e9019e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:50.961156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 155/305] 10.222.0.55 () {60 vars in 1134 bytes} [Fri Sep 2 09:12:50 2022] POST /identity/v3/groups => generated 229 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:51.039312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 151/306] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:51.221275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bef9fb-fa7e-40c6-818a-3cecfec9bf75 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:51.221588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bef9fb-fa7e-40c6-818a-3cecfec9bf75 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:51.221974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bef9fb-fa7e-40c6-818a-3cecfec9bf75 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:51.224265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 156/307] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:51.231614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e5e6-b5c9-45fd-adf1-71da3036ce42 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:51.232046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e5e6-b5c9-45fd-adf1-71da3036ce42 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:51.232430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e5e6-b5c9-45fd-adf1-71da3036ce42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:51.257785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7a33e5e6-b5c9-45fd-adf1-71da3036ce42 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:51.260360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7a33e5e6-b5c9-45fd-adf1-71da3036ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:51.314783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bef9fb-fa7e-40c6-818a-3cecfec9bf75 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:51.351024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 152/308] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:51.440620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bef9fb-fa7e-40c6-818a-3cecfec9bf75 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:51.473659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4d37f-5189-4b85-87ee-be25f8a9e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:51.474521 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d37f-5189-4b85-87ee-be25f8a9e48d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:51.474941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d37f-5189-4b85-87ee-be25f8a9e48d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:51.475351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d37f-5189-4b85-87ee-be25f8a9e48d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:51.486510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4d37f-5189-4b85-87ee-be25f8a9e48d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a1e4d37f-5189-4b85-87ee-be25f8a9e48d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:51.492455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:51.493520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:51.494985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:51.497131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 157/309] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:51.503927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33e5e6-b5c9-45fd-adf1-71da3036ce42 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:51.526181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:51.609389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33e5e6-b5c9-45fd-adf1-71da3036ce42 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:51.645283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c94d3-9bc4-4e90-bdf0-7ec0d732feda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:51.646206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c94d3-9bc4-4e90-bdf0-7ec0d732feda None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:51.646661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c94d3-9bc4-4e90-bdf0-7ec0d732feda None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:51.647106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c94d3-9bc4-4e90-bdf0-7ec0d732feda None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:51.648016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c94d3-9bc4-4e90-bdf0-7ec0d732feda None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:51.648512 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c94d3-9bc4-4e90-bdf0-7ec0d732feda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:51.650220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c94d3-9bc4-4e90-bdf0-7ec0d732feda None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:51.658955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 153/310] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:51.665173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4d37f-5189-4b85-87ee-be25f8a9e48d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:51.693885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:51.706265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c94d3-9bc4-4e90-bdf0-7ec0d732feda None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:51.784172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4d37f-5189-4b85-87ee-be25f8a9e48d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:51.822186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:51.826332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf6a19-7b65-4d7e-b50a-c35bfdad1602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:51.827252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf6a19-7b65-4d7e-b50a-c35bfdad1602 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:51.827722 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf6a19-7b65-4d7e-b50a-c35bfdad1602 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:51.828346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf6a19-7b65-4d7e-b50a-c35bfdad1602 None admin] PATH_INFO: `/v3/users/e0a8ea39e70c4348946d7e79a6e9a53e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:51.829749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf6a19-7b65-4d7e-b50a-c35bfdad1602 None admin] RBAC: Authorizing `identity:get_user(user_id=e0a8ea39e70c4348946d7e79a6e9a53e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:51.831391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf6a19-7b65-4d7e-b50a-c35bfdad1602 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:51.833461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 158/311] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:51 2022] GET /identity/v3/users/e0a8ea39e70c4348946d7e79a6e9a53e => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:51.841326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf6a19-7b65-4d7e-b50a-c35bfdad1602 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:51.841720 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c94d3-9bc4-4e90-bdf0-7ec0d732feda None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:51.878033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dba98-b3a5-40a0-ae5a-e70ba9b90616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:51.878874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dba98-b3a5-40a0-ae5a-e70ba9b90616 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:51.878981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dba98-b3a5-40a0-ae5a-e70ba9b90616 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:51.879195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dba98-b3a5-40a0-ae5a-e70ba9b90616 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:51.890020 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dba98-b3a5-40a0-ae5a-e70ba9b90616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-155dba98-b3a5-40a0-ae5a-e70ba9b90616 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:51.895498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:51.896405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:51.902454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 154/312] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:12:51.905176 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dba98-b3a5-40a0-ae5a-e70ba9b90616 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:51.956433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:51.966865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf6a19-7b65-4d7e-b50a-c35bfdad1602 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:52.003861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c43507-0b27-40fe-839c-4bf88742d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:52.004758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c43507-0b27-40fe-839c-4bf88742d26e None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:52.005299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c43507-0b27-40fe-839c-4bf88742d26e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:52.005738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c43507-0b27-40fe-839c-4bf88742d26e None admin] PATH_INFO: `/v3/system/users/e0a8ea39e70c4348946d7e79a6e9a53e/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:52.008285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c43507-0b27-40fe-839c-4bf88742d26e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e0a8ea39e70c4348946d7e79a6e9a53e, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:52.010007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c43507-0b27-40fe-839c-4bf88742d26e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:52.012494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dba98-b3a5-40a0-ae5a-e70ba9b90616 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:52.050672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3b0e3-1bcd-421e-8326-d8719d0390ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:52.051522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3b0e3-1bcd-421e-8326-d8719d0390ee None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:52.051849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3b0e3-1bcd-421e-8326-d8719d0390ee None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:52.052267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3b0e3-1bcd-421e-8326-d8719d0390ee None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:52.052870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3b0e3-1bcd-421e-8326-d8719d0390ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:52.056776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3b0e3-1bcd-421e-8326-d8719d0390ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:52.056776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3b0e3-1bcd-421e-8326-d8719d0390ee None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:52.066561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 155/313] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:52.072518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3b0e3-1bcd-421e-8326-d8719d0390ee None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:52.076570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:52.105215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 159/314] 10.222.0.55 () {58 vars in 1334 bytes} [Fri Sep 2 09:12:51 2022] PUT /identity/v3/system/users/e0a8ea39e70c4348946d7e79a6e9a53e/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:12:52.201352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3b0e3-1bcd-421e-8326-d8719d0390ee None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:52.241629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3d666-7a49-42db-b373-727740598213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:52.242359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3d666-7a49-42db-b373-727740598213 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:52.242676 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3d666-7a49-42db-b373-727740598213 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:52.242959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3d666-7a49-42db-b373-727740598213 None admin] PATH_INFO: `/v3/users/5abdb0c9d77f48b6aff052dc47c1a5dd` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:52.244313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3d666-7a49-42db-b373-727740598213 None admin] RBAC: Authorizing `identity:get_user(user_id=5abdb0c9d77f48b6aff052dc47c1a5dd)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:52.245798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3d666-7a49-42db-b373-727740598213 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:52.247813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 156/315] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:52 2022] GET /identity/v3/users/5abdb0c9d77f48b6aff052dc47c1a5dd => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:52.253816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c43507-0b27-40fe-839c-4bf88742d26e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:52.360905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c43507-0b27-40fe-839c-4bf88742d26e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:52.396352 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ff683-89f2-4d07-86e5-fbd636943f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:52.396962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ff683-89f2-4d07-86e5-fbd636943f62 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:52.397236 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ff683-89f2-4d07-86e5-fbd636943f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:52.397506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ff683-89f2-4d07-86e5-fbd636943f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:52.456914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:52.501193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ff683-89f2-4d07-86e5-fbd636943f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:52.503098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ff683-89f2-4d07-86e5-fbd636943f62 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:52.605396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 160/316] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:52.611000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3d666-7a49-42db-b373-727740598213 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:52.686663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:52.720898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3d666-7a49-42db-b373-727740598213 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:52.756266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e90c2-1de6-427f-b467-446e4e4efe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:52.756947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e90c2-1de6-427f-b467-446e4e4efe2e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:52.757223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e90c2-1de6-427f-b467-446e4e4efe2e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:52.757492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e90c2-1de6-427f-b467-446e4e4efe2e None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:52.758597 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e90c2-1de6-427f-b467-446e4e4efe2e None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:52.760829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e90c2-1de6-427f-b467-446e4e4efe2e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:52.762730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 157/317] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:52 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:52.769030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ff683-89f2-4d07-86e5-fbd636943f62 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:52.860242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:52.899271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ff683-89f2-4d07-86e5-fbd636943f62 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:52.947576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d3cce-d16c-4dc5-ae99-395357faba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:52.948436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d3cce-d16c-4dc5-ae99-395357faba4e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:52.948874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d3cce-d16c-4dc5-ae99-395357faba4e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:52.949254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d3cce-d16c-4dc5-ae99-395357faba4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:52.950292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d3cce-d16c-4dc5-ae99-395357faba4e None admin] RBAC: Adding query filter params (role.id=9b25ee87d1f947dcb8683d955a7c467f, scope.project.id=5e21e073540045728f2ced13ce6d6eea, user.id=5abdb0c9d77f48b6aff052dc47c1a5dd) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:52.950727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d3cce-d16c-4dc5-ae99-395357faba4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:52.952928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d3cce-d16c-4dc5-ae99-395357faba4e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:52.961550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 161/318] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:12:52 2022] GET /identity/v3/role_assignments?user.id=5abdb0c9d77f48b6aff052dc47c1a5dd&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=9b25ee87d1f947dcb8683d955a7c467f => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:53.057834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb49a-5c61-4147-a1e3-e42552a07f87 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:53.058481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb49a-5c61-4147-a1e3-e42552a07f87 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:53.058971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb49a-5c61-4147-a1e3-e42552a07f87 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:53.060852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 158/319] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:53.066586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6d8c0-b884-4eea-9ed4-49ab5d2b24e9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:53.067144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6d8c0-b884-4eea-9ed4-49ab5d2b24e9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:53.067638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6d8c0-b884-4eea-9ed4-49ab5d2b24e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:53.088163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-93a6d8c0-b884-4eea-9ed4-49ab5d2b24e9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:53.089735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-93a6d8c0-b884-4eea-9ed4-49ab5d2b24e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:53.163031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 162/320] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:53.320889 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65ccf6-89c1-4cee-ad27-a817d42ff5c8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:53.327948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65ccf6-89c1-4cee-ad27-a817d42ff5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:53.327948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65ccf6-89c1-4cee-ad27-a817d42ff5c8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:53.327948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 159/321] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:53.330880 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683c8c-64ee-4086-a4ae-83b13c907262 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:53.331173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683c8c-64ee-4086-a4ae-83b13c907262 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:53.331569 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683c8c-64ee-4086-a4ae-83b13c907262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:53.350286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1b683c8c-64ee-4086-a4ae-83b13c907262 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:53.351763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1b683c8c-64ee-4086-a4ae-83b13c907262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:53.435315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65ccf6-89c1-4cee-ad27-a817d42ff5c8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:53.492170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:53.523209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 163/322] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:53.566606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65ccf6-89c1-4cee-ad27-a817d42ff5c8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:53.610158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4472d-ee02-434d-bc1c-2f9fea52e859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:53.610786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4472d-ee02-434d-bc1c-2f9fea52e859 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:53.611057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4472d-ee02-434d-bc1c-2f9fea52e859 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:53.611584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4472d-ee02-434d-bc1c-2f9fea52e859 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:53.612806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4472d-ee02-434d-bc1c-2f9fea52e859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:53.615668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4472d-ee02-434d-bc1c-2f9fea52e859 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:53.618264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 160/323] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:12:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:53.624805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b683c8c-64ee-4086-a4ae-83b13c907262 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:53.736739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b683c8c-64ee-4086-a4ae-83b13c907262 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:53.772901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab49ab-f851-4ecf-b21d-72ba9f0f5b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:53.773511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab49ab-f851-4ecf-b21d-72ba9f0f5b0b None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:53.773784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab49ab-f851-4ecf-b21d-72ba9f0f5b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:53.774049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab49ab-f851-4ecf-b21d-72ba9f0f5b0b None admin] PATH_INFO: `/v3/groups` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:53.774676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab49ab-f851-4ecf-b21d-72ba9f0f5b0b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:53.776234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab49ab-f851-4ecf-b21d-72ba9f0f5b0b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:53.809915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4472d-ee02-434d-bc1c-2f9fea52e859 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:53.822856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:53.863920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 164/324] 10.222.0.55 () {60 vars in 1134 bytes} [Fri Sep 2 09:12:53 2022] POST /identity/v3/groups => generated 226 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:12:53.932020 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4472d-ee02-434d-bc1c-2f9fea52e859 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:53.967967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8504-421a-47e5-b048-cd322fa2a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:53.968645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8504-421a-47e5-b048-cd322fa2a5ec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:53.968919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8504-421a-47e5-b048-cd322fa2a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:53.969184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8504-421a-47e5-b048-cd322fa2a5ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:53.981258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8504-421a-47e5-b048-cd322fa2a5ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-070f8504-421a-47e5-b048-cd322fa2a5ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:53.986696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:53.987605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:53.992774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 161/325] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:12:53.994468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab49ab-f851-4ecf-b21d-72ba9f0f5b0b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:54.038852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:54.101066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab49ab-f851-4ecf-b21d-72ba9f0f5b0b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:54.139336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09820631-de1c-459a-8c60-a0812f8d6eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:54.140343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09820631-de1c-459a-8c60-a0812f8d6eba None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:54.140827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09820631-de1c-459a-8c60-a0812f8d6eba None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:54.141289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09820631-de1c-459a-8c60-a0812f8d6eba None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:54.142168 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09820631-de1c-459a-8c60-a0812f8d6eba None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:54.142676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09820631-de1c-459a-8c60-a0812f8d6eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:54.144290 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09820631-de1c-459a-8c60-a0812f8d6eba None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:54.153653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 165/326] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:54.160640 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8504-421a-47e5-b048-cd322fa2a5ec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:54.164403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977dd30-3898-4b06-801d-4c9cb5eee4f8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:54.164690 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977dd30-3898-4b06-801d-4c9cb5eee4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:54.164952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977dd30-3898-4b06-801d-4c9cb5eee4f8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:54.166868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 166/327] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:12:54.172373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d6529-4ddb-4faf-a2d3-04766e60a04b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:54.172663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d6529-4ddb-4faf-a2d3-04766e60a04b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:54.172941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d6529-4ddb-4faf-a2d3-04766e60a04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:54.192107 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-405d6529-4ddb-4faf-a2d3-04766e60a04b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:54.193311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-405d6529-4ddb-4faf-a2d3-04766e60a04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:54.238113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:54.277866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 167/328] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:54.293460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8504-421a-47e5-b048-cd322fa2a5ec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:54.330160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1854e-090b-4e8e-9f5a-ecd17713b4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:54.330794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1854e-090b-4e8e-9f5a-ecd17713b4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:54.331080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1854e-090b-4e8e-9f5a-ecd17713b4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:54.331352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1854e-090b-4e8e-9f5a-ecd17713b4a2 None admin] PATH_INFO: `/v3/users/0671bb88efed4cff93ffdfd87e048079` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:54.332503 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1854e-090b-4e8e-9f5a-ecd17713b4a2 None admin] RBAC: Authorizing `identity:get_user(user_id=0671bb88efed4cff93ffdfd87e048079)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:54.333951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1854e-090b-4e8e-9f5a-ecd17713b4a2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:54.335694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 162/329] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:54 2022] GET /identity/v3/users/0671bb88efed4cff93ffdfd87e048079 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:54.342037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d6529-4ddb-4faf-a2d3-04766e60a04b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:54.377082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:54.453372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d6529-4ddb-4faf-a2d3-04766e60a04b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:54.491379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aec0a-1b0f-4dd0-8b9f-acc2aad3f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:54.492003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aec0a-1b0f-4dd0-8b9f-acc2aad3f20c None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:54.492284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aec0a-1b0f-4dd0-8b9f-acc2aad3f20c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:54.492795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aec0a-1b0f-4dd0-8b9f-acc2aad3f20c None admin] PATH_INFO: `/v3/system/users/0671bb88efed4cff93ffdfd87e048079/roles/9b25ee87d1f947dcb8683d955a7c467f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:54.494013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aec0a-1b0f-4dd0-8b9f-acc2aad3f20c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0671bb88efed4cff93ffdfd87e048079, role_id=9b25ee87d1f947dcb8683d955a7c467f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:54.495422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aec0a-1b0f-4dd0-8b9f-acc2aad3f20c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:54.579201 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 168/330] 10.222.0.55 () {58 vars in 1334 bytes} [Fri Sep 2 09:12:54 2022] PUT /identity/v3/system/users/0671bb88efed4cff93ffdfd87e048079/roles/9b25ee87d1f947dcb8683d955a7c467f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:12:54.581387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1854e-090b-4e8e-9f5a-ecd17713b4a2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:54.719561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1854e-090b-4e8e-9f5a-ecd17713b4a2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:54.768256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612ade-4e61-4342-b889-d8b4ca32717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:54.769264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612ade-4e61-4342-b889-d8b4ca32717c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:54.769759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612ade-4e61-4342-b889-d8b4ca32717c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:54.770293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612ade-4e61-4342-b889-d8b4ca32717c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:54.777201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:54.791034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4612ade-4e61-4342-b889-d8b4ca32717c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a4612ade-4e61-4342-b889-d8b4ca32717c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:54.796065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:54.796910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:54.797712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 163/331] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:54.803414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aec0a-1b0f-4dd0-8b9f-acc2aad3f20c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:54.920694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:54.926873 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aec0a-1b0f-4dd0-8b9f-acc2aad3f20c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:54.964789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9696b-969e-4b50-8333-a1c3889f1f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:54.965446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9696b-969e-4b50-8333-a1c3889f1f10 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:54.965719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9696b-969e-4b50-8333-a1c3889f1f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:54.966032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9696b-969e-4b50-8333-a1c3889f1f10 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:54.966703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9696b-969e-4b50-8333-a1c3889f1f10 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:54.967002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9696b-969e-4b50-8333-a1c3889f1f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:54.968403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9696b-969e-4b50-8333-a1c3889f1f10 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:54.978907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 169/332] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:54.984645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612ade-4e61-4342-b889-d8b4ca32717c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:55.098232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612ade-4e61-4342-b889-d8b4ca32717c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:55.140206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5e73a-c1f5-4f70-9411-26dcac572cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:55.140842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5e73a-c1f5-4f70-9411-26dcac572cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:55.141115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5e73a-c1f5-4f70-9411-26dcac572cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:55.141386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5e73a-c1f5-4f70-9411-26dcac572cc1 None admin] PATH_INFO: `/v3/users/e0a8ea39e70c4348946d7e79a6e9a53e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:55.146534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5e73a-c1f5-4f70-9411-26dcac572cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=e0a8ea39e70c4348946d7e79a6e9a53e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:55.148024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5e73a-c1f5-4f70-9411-26dcac572cc1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:55.149692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 164/333] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:54 2022] GET /identity/v3/users/e0a8ea39e70c4348946d7e79a6e9a53e => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:55.155706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9696b-969e-4b50-8333-a1c3889f1f10 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:55.274599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9696b-969e-4b50-8333-a1c3889f1f10 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:55.319998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54e9ca-5797-47b3-9643-2ba58fd68951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:55.323610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e9ca-5797-47b3-9643-2ba58fd68951 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:55.323610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e9ca-5797-47b3-9643-2ba58fd68951 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:55.323610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e9ca-5797-47b3-9643-2ba58fd68951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:55.323610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54e9ca-5797-47b3-9643-2ba58fd68951 None admin] RBAC: Adding query filter params (role.id=8941b3ff5a124d0a918ea79de7649945, user.id=e0a8ea39e70c4348946d7e79a6e9a53e, scope.system=all) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:55.323610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54e9ca-5797-47b3-9643-2ba58fd68951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:55.323610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54e9ca-5797-47b3-9643-2ba58fd68951 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:55.339266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 170/334] 10.222.0.55 () {56 vars in 1308 bytes} [Fri Sep 2 09:12:55 2022] GET /identity/v3/role_assignments?user.id=e0a8ea39e70c4348946d7e79a6e9a53e&scope.system=all&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:56.286031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577afdc2-18d7-42fc-86ec-51d47c72e6df None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:56.286717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577afdc2-18d7-42fc-86ec-51d47c72e6df None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:56.286717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577afdc2-18d7-42fc-86ec-51d47c72e6df None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:56.287908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 165/335] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:56.293229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b6314-5a13-4827-924b-61ec44022189 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:56.293805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b6314-5a13-4827-924b-61ec44022189 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:56.293805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b6314-5a13-4827-924b-61ec44022189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:56.316458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5b1b6314-5a13-4827-924b-61ec44022189 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:56.317722 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5b1b6314-5a13-4827-924b-61ec44022189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:56.333743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:56.403588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 171/336] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:56.878441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffcba3-9302-4862-9437-a0e97289be48 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:56.878767 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffcba3-9302-4862-9437-a0e97289be48 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:56.878979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffcba3-9302-4862-9437-a0e97289be48 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:56.880602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 166/337] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:56.887136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4080bc-d3c1-4ade-942b-366cdeff289f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:56.887419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4080bc-d3c1-4ade-942b-366cdeff289f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:56.887690 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4080bc-d3c1-4ade-942b-366cdeff289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:56.906911 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-de4080bc-d3c1-4ade-942b-366cdeff289f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:56.908106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-de4080bc-d3c1-4ade-942b-366cdeff289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:56.938324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffcba3-9302-4862-9437-a0e97289be48 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:57.024358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 172/338] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:57.046135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:57.088868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffcba3-9302-4862-9437-a0e97289be48 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:57.126388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d747227-4ec2-408f-942e-a6914fe81e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:57.126976 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d747227-4ec2-408f-942e-a6914fe81e2e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:57.127259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d747227-4ec2-408f-942e-a6914fe81e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:57.127524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d747227-4ec2-408f-942e-a6914fe81e2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:57.139829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d747227-4ec2-408f-942e-a6914fe81e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-0d747227-4ec2-408f-942e-a6914fe81e2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:57.145236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:57.146091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:57.146879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 167/339] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:57.152752 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4080bc-d3c1-4ade-942b-366cdeff289f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:57.238160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:57.262323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4080bc-d3c1-4ade-942b-366cdeff289f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:57.309654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1aac7-8a4e-4855-b4d5-d2027874173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:57.310324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1aac7-8a4e-4855-b4d5-d2027874173b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:57.310531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1aac7-8a4e-4855-b4d5-d2027874173b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:57.310800 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1aac7-8a4e-4855-b4d5-d2027874173b None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:57.311470 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1aac7-8a4e-4855-b4d5-d2027874173b None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:57.311773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1aac7-8a4e-4855-b4d5-d2027874173b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:57.313191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1aac7-8a4e-4855-b4d5-d2027874173b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:57.326962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 173/340] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:57.332165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d747227-4ec2-408f-942e-a6914fe81e2e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:57.407614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eba36d-5c8e-4cd8-9598-248cb34841f2 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:57.407796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eba36d-5c8e-4cd8-9598-248cb34841f2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:57.408311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eba36d-5c8e-4cd8-9598-248cb34841f2 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:57.410282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 174/341] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:57.415346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7998f54-77b3-4d6c-a309-a652670ab105 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:57.415931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7998f54-77b3-4d6c-a309-a652670ab105 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:57.416419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7998f54-77b3-4d6c-a309-a652670ab105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:57.448887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c7998f54-77b3-4d6c-a309-a652670ab105 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:57.450420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c7998f54-77b3-4d6c-a309-a652670ab105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:57.468961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d747227-4ec2-408f-942e-a6914fe81e2e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:57.500257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:57.521811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554e14-9555-4692-b733-194c3207a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:57.522986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554e14-9555-4692-b733-194c3207a64d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:57.527987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554e14-9555-4692-b733-194c3207a64d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:57.528282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554e14-9555-4692-b733-194c3207a64d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:57.565633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 175/342] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:57.566527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7998f54-77b3-4d6c-a309-a652670ab105 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:57.656456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554e14-9555-4692-b733-194c3207a64d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:57.657998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554e14-9555-4692-b733-194c3207a64d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:57.664368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:57.683549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7998f54-77b3-4d6c-a309-a652670ab105 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:57.723548 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fcdbc-0d99-4d1f-8fac-b16dbddd7de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:57.724215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fcdbc-0d99-4d1f-8fac-b16dbddd7de8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:57.724595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fcdbc-0d99-4d1f-8fac-b16dbddd7de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:57.724878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fcdbc-0d99-4d1f-8fac-b16dbddd7de8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:57.738110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fcdbc-0d99-4d1f-8fac-b16dbddd7de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c41fcdbc-0d99-4d1f-8fac-b16dbddd7de8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:57.743725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:57.745146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:57.745931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:57.747072 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 176/343] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:12:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:57.752671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fcdbc-0d99-4d1f-8fac-b16dbddd7de8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:57.800252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 168/344] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:57.801223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554e14-9555-4692-b733-194c3207a64d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:57.841429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:57.866881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fcdbc-0d99-4d1f-8fac-b16dbddd7de8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:57.896346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:57.916871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55a1d6-387d-442c-9cd5-15eec7a0fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:57.916871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55a1d6-387d-442c-9cd5-15eec7a0fca2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:57.916871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55a1d6-387d-442c-9cd5-15eec7a0fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:57.916871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55a1d6-387d-442c-9cd5-15eec7a0fca2 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:57.917232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55a1d6-387d-442c-9cd5-15eec7a0fca2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:57.917232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55a1d6-387d-442c-9cd5-15eec7a0fca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:57.917232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55a1d6-387d-442c-9cd5-15eec7a0fca2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:57.936591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 177/345] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:12:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:12:57.937645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d060a47-a649-4694-8c20-fc5e050f46e1 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:57.937925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d060a47-a649-4694-8c20-fc5e050f46e1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:57.938192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d060a47-a649-4694-8c20-fc5e050f46e1 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:57.939429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 178/346] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:57.945792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8239de4-93a3-47c9-8869-972f1bb4775b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:57.946093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8239de4-93a3-47c9-8869-972f1bb4775b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:57.946331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8239de4-93a3-47c9-8869-972f1bb4775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:57.985743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554e14-9555-4692-b733-194c3207a64d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:57.988062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b8239de4-93a3-47c9-8869-972f1bb4775b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:57.989352 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b8239de4-93a3-47c9-8869-972f1bb4775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:58.053490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc6890-d328-4941-821a-beb46f600a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:58.054195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6890-d328-4941-821a-beb46f600a75 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:58.054474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6890-d328-4941-821a-beb46f600a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:58.054739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6890-d328-4941-821a-beb46f600a75 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:58.060584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc6890-d328-4941-821a-beb46f600a75 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:58.062034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc6890-d328-4941-821a-beb46f600a75 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:58.063690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 169/347] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:57 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:58.064554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc6890-d328-4941-821a-beb46f600a75 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:58.077582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 179/348] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:58.078507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8239de4-93a3-47c9-8869-972f1bb4775b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:58.189988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8239de4-93a3-47c9-8869-972f1bb4775b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:58.214829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:58.219663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:58.229968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318a2ee-38bd-4332-b878-888db51dc7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:58.230602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318a2ee-38bd-4332-b878-888db51dc7df None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:58.230873 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318a2ee-38bd-4332-b878-888db51dc7df None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:58.231136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318a2ee-38bd-4332-b878-888db51dc7df None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:58.231700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc6890-d328-4941-821a-beb46f600a75 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:58.237098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318a2ee-38bd-4332-b878-888db51dc7df None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:58.238615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318a2ee-38bd-4332-b878-888db51dc7df None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:58.240550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 180/349] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:12:58 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:58.241354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318a2ee-38bd-4332-b878-888db51dc7df None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:58.276607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967cd83-6e87-4046-807b-8d090b5572e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:58.278357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967cd83-6e87-4046-807b-8d090b5572e0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:58.278857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967cd83-6e87-4046-807b-8d090b5572e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:58.279504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967cd83-6e87-4046-807b-8d090b5572e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:58.364216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318a2ee-38bd-4332-b878-888db51dc7df None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:58.380623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967cd83-6e87-4046-807b-8d090b5572e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:58.382455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967cd83-6e87-4046-807b-8d090b5572e0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:58.416184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24f8cd-bd7e-4879-918d-49c82c966125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:58.417192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f8cd-bd7e-4879-918d-49c82c966125 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:58.417670 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f8cd-bd7e-4879-918d-49c82c966125 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:58.418147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f8cd-bd7e-4879-918d-49c82c966125 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:58.435368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24f8cd-bd7e-4879-918d-49c82c966125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8c24f8cd-bd7e-4879-918d-49c82c966125 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:58.441015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:58.441917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:12:58.443196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 181/350] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:58.443865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f69996-4040-4ee6-bd0c-3fb3fcf15f5a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:58.443865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f69996-4040-4ee6-bd0c-3fb3fcf15f5a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:58.448285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f69996-4040-4ee6-bd0c-3fb3fcf15f5a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:58.450228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 182/351] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:58.451713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f69996-4040-4ee6-bd0c-3fb3fcf15f5a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:58.506222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:58.508054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:58.519690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 170/352] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:58.520849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967cd83-6e87-4046-807b-8d090b5572e0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:58.587032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f69996-4040-4ee6-bd0c-3fb3fcf15f5a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:58.626761 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300b74e-cd85-4815-9ae0-644a365696d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:58.627377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b74e-cd85-4815-9ae0-644a365696d0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:58.627948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b74e-cd85-4815-9ae0-644a365696d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:58.628053 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b74e-cd85-4815-9ae0-644a365696d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:58.630206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300b74e-cd85-4815-9ae0-644a365696d0 None admin] RBAC: Adding query filter params (group.id=827fa2529be14c41bb1d35fa652d4556, role.id=8941b3ff5a124d0a918ea79de7649945, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:58.630206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300b74e-cd85-4815-9ae0-644a365696d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:58.631229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300b74e-cd85-4815-9ae0-644a365696d0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:58.638508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 183/353] 10.222.0.55 () {56 vars in 1376 bytes} [Fri Sep 2 09:12:58 2022] GET /identity/v3/role_assignments?group.id=827fa2529be14c41bb1d35fa652d4556&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:58.639445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300b74e-cd85-4815-9ae0-644a365696d0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:58.660568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967cd83-6e87-4046-807b-8d090b5572e0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:58.720912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c5337-9bfc-4aa4-972a-282f19d8f544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:58.721550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c5337-9bfc-4aa4-972a-282f19d8f544 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:58.721828 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c5337-9bfc-4aa4-972a-282f19d8f544 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:58.722096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c5337-9bfc-4aa4-972a-282f19d8f544 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:58.734701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c5337-9bfc-4aa4-972a-282f19d8f544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a57c5337-9bfc-4aa4-972a-282f19d8f544 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:58.740448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:58.741390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 09:12:58.742170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:58.745171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 171/354] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:12:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:58.746681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95281cd9-c3ea-4caf-b2c1-f732000a1bb2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:58.747190 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95281cd9-c3ea-4caf-b2c1-f732000a1bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:58.747652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95281cd9-c3ea-4caf-b2c1-f732000a1bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:58.768755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-95281cd9-c3ea-4caf-b2c1-f732000a1bb2 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:58.770317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-95281cd9-c3ea-4caf-b2c1-f732000a1bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:58.790967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300b74e-cd85-4815-9ae0-644a365696d0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:58.806123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:58.838407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:58.845403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150013a-28e5-4499-aa3e-b46d8c2880ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:58.846632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150013a-28e5-4499-aa3e-b46d8c2880ba None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:58.847351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150013a-28e5-4499-aa3e-b46d8c2880ba None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:58.848121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150013a-28e5-4499-aa3e-b46d8c2880ba None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:58.849190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150013a-28e5-4499-aa3e-b46d8c2880ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:58.849614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150013a-28e5-4499-aa3e-b46d8c2880ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:58.851599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150013a-28e5-4499-aa3e-b46d8c2880ba None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:58.856985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 172/355] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:58.858242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95281cd9-c3ea-4caf-b2c1-f732000a1bb2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:58.862691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 184/356] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:58.863508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150013a-28e5-4499-aa3e-b46d8c2880ba None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:58.979102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95281cd9-c3ea-4caf-b2c1-f732000a1bb2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:59.002438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150013a-28e5-4499-aa3e-b46d8c2880ba None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:59.022693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a3f86-3905-436c-9b3b-2388d1195940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:59.023634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a3f86-3905-436c-9b3b-2388d1195940 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.024186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a3f86-3905-436c-9b3b-2388d1195940 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.024633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a3f86-3905-436c-9b3b-2388d1195940 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.025985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a3f86-3905-436c-9b3b-2388d1195940 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:59.027724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a3f86-3905-436c-9b3b-2388d1195940 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:59.029868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 173/357] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:58 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:59.030987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a3f86-3905-436c-9b3b-2388d1195940 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:59.048304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ce648-1d39-4d4d-845d-18dfa13c6801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:59.048930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ce648-1d39-4d4d-845d-18dfa13c6801 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.049212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ce648-1d39-4d4d-845d-18dfa13c6801 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.049495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ce648-1d39-4d4d-845d-18dfa13c6801 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.050338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ce648-1d39-4d4d-845d-18dfa13c6801 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:59.050641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ce648-1d39-4d4d-845d-18dfa13c6801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:59.052735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ce648-1d39-4d4d-845d-18dfa13c6801 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:59.063268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 185/358] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:12:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:59.064827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b432ca3-068d-4599-a96f-3e31413bca2a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.065124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b432ca3-068d-4599-a96f-3e31413bca2a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.065402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b432ca3-068d-4599-a96f-3e31413bca2a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.066950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 186/359] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:12:59.072253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b432ca3-068d-4599-a96f-3e31413bca2a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:59.098642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:59.111958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:59.158274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a3f86-3905-436c-9b3b-2388d1195940 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:59.201127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad04a08-652f-4fb7-a6f1-d5227038fa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:59.202202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04a08-652f-4fb7-a6f1-d5227038fa51 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.202746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04a08-652f-4fb7-a6f1-d5227038fa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.203212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b432ca3-068d-4599-a96f-3e31413bca2a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:59.203564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04a08-652f-4fb7-a6f1-d5227038fa51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.246177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefb5e8-a1c1-4362-845d-a4f9797102e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:59.246846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefb5e8-a1c1-4362-845d-a4f9797102e5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.247125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefb5e8-a1c1-4362-845d-a4f9797102e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.247398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefb5e8-a1c1-4362-845d-a4f9797102e5 None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.249501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefb5e8-a1c1-4362-845d-a4f9797102e5 None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:59.251042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefb5e8-a1c1-4362-845d-a4f9797102e5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:59.252720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 187/360] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:12:59 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:59.254109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefb5e8-a1c1-4362-845d-a4f9797102e5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:59.285198 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad04a08-652f-4fb7-a6f1-d5227038fa51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:59.286992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad04a08-652f-4fb7-a6f1-d5227038fa51 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:59.351868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:59.371952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:59.375955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefb5e8-a1c1-4362-845d-a4f9797102e5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:59.418926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d854e2-121b-476d-bfca-b8dd5d864862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:59.419553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d854e2-121b-476d-bfca-b8dd5d864862 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.419829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d854e2-121b-476d-bfca-b8dd5d864862 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.420128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d854e2-121b-476d-bfca-b8dd5d864862 None admin] PATH_INFO: `/v3/users/0671bb88efed4cff93ffdfd87e048079` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.421233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d854e2-121b-476d-bfca-b8dd5d864862 None admin] RBAC: Authorizing `identity:get_user(user_id=0671bb88efed4cff93ffdfd87e048079)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:59.422668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d854e2-121b-476d-bfca-b8dd5d864862 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:59.424282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 188/361] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:12:59 2022] GET /identity/v3/users/0671bb88efed4cff93ffdfd87e048079 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:59.425498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 174/362] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:59.426926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad04a08-652f-4fb7-a6f1-d5227038fa51 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:59.432249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eceb45-0ef1-410f-93e6-b4d03399f86c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.432572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eceb45-0ef1-410f-93e6-b4d03399f86c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.432846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eceb45-0ef1-410f-93e6-b4d03399f86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.456311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a3eceb45-0ef1-410f-93e6-b4d03399f86c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:12:59.457430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a3eceb45-0ef1-410f-93e6-b4d03399f86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:12:59.545993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 189/363] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:59.546479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eceb45-0ef1-410f-93e6-b4d03399f86c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:59.557367 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad04a08-652f-4fb7-a6f1-d5227038fa51 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:59.605639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f830f-91f9-4277-8600-04f0d424c846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:59.606826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f830f-91f9-4277-8600-04f0d424c846 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.607242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f830f-91f9-4277-8600-04f0d424c846 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.607647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f830f-91f9-4277-8600-04f0d424c846 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.622251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f830f-91f9-4277-8600-04f0d424c846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-147f830f-91f9-4277-8600-04f0d424c846 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:12:59.629278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:12:59.630321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:12:59.631290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:12:59.636843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 175/364] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:12:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:12:59.636843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f830f-91f9-4277-8600-04f0d424c846 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:59.657414 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:59.670375 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:59.674498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eceb45-0ef1-410f-93e6-b4d03399f86c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:59.722325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781a1b9-3e59-48a5-aa85-e879834467bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:59.723273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781a1b9-3e59-48a5-aa85-e879834467bc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.723689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781a1b9-3e59-48a5-aa85-e879834467bc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.724218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781a1b9-3e59-48a5-aa85-e879834467bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.725217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781a1b9-3e59-48a5-aa85-e879834467bc None admin] RBAC: Adding query filter params (group.id=827fa2529be14c41bb1d35fa652d4556, role.id=5691b81a7afd45eca087af3298e82784, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:59.725720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781a1b9-3e59-48a5-aa85-e879834467bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:59.728160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781a1b9-3e59-48a5-aa85-e879834467bc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:59.736231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 190/365] 10.222.0.55 () {56 vars in 1376 bytes} [Fri Sep 2 09:12:59 2022] GET /identity/v3/role_assignments?group.id=827fa2529be14c41bb1d35fa652d4556&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=5691b81a7afd45eca087af3298e82784 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:59.737887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781a1b9-3e59-48a5-aa85-e879834467bc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:59.777998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f830f-91f9-4277-8600-04f0d424c846 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:59.827485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c1801-f40f-4852-a1cd-7743602d77e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:59.828478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c1801-f40f-4852-a1cd-7743602d77e5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.828951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c1801-f40f-4852-a1cd-7743602d77e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.830358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c1801-f40f-4852-a1cd-7743602d77e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.831353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c1801-f40f-4852-a1cd-7743602d77e5 None admin] RBAC: Adding query filter params (role.id=9b25ee87d1f947dcb8683d955a7c467f, user.id=0671bb88efed4cff93ffdfd87e048079, scope.system=all) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:12:59.831918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c1801-f40f-4852-a1cd-7743602d77e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:59.833630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c1801-f40f-4852-a1cd-7743602d77e5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:59.853756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 176/366] 10.222.0.55 () {56 vars in 1308 bytes} [Fri Sep 2 09:12:59 2022] GET /identity/v3/role_assignments?user.id=0671bb88efed4cff93ffdfd87e048079&scope.system=all&role.id=9b25ee87d1f947dcb8683d955a7c467f => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:59.855021 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c1801-f40f-4852-a1cd-7743602d77e5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:12:59.899362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781a1b9-3e59-48a5-aa85-e879834467bc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:12:59.970865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:59.972856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e56b8-421d-4aa1-a439-9a4d22ef344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:12:59.972856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e56b8-421d-4aa1-a439-9a4d22ef344c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:12:59.973084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e56b8-421d-4aa1-a439-9a4d22ef344c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:12:59.973265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e56b8-421d-4aa1-a439-9a4d22ef344c None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:12:59.975452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e56b8-421d-4aa1-a439-9a4d22ef344c None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:12:59.976958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e56b8-421d-4aa1-a439-9a4d22ef344c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:12:59.979418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 191/367] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:12:59 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:12:59.980159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e56b8-421d-4aa1-a439-9a4d22ef344c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:00.031383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c1801-f40f-4852-a1cd-7743602d77e5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:00.056262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:00.109714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89fcc4-1d9a-42e0-bd2a-e8017566f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:00.110251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89fcc4-1d9a-42e0-bd2a-e8017566f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:00.110526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89fcc4-1d9a-42e0-bd2a-e8017566f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:00.110797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89fcc4-1d9a-42e0-bd2a-e8017566f8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:00.111916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89fcc4-1d9a-42e0-bd2a-e8017566f8d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:00.112289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89fcc4-1d9a-42e0-bd2a-e8017566f8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:00.114129 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89fcc4-1d9a-42e0-bd2a-e8017566f8d0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:00.131411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e56b8-421d-4aa1-a439-9a4d22ef344c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:00.131964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 177/368] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:12:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:00.133057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89fcc4-1d9a-42e0-bd2a-e8017566f8d0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:00.171135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aba37-76ef-4045-8895-d92fc4217e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:00.171801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aba37-76ef-4045-8895-d92fc4217e4e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:00.172132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aba37-76ef-4045-8895-d92fc4217e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:00.172554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aba37-76ef-4045-8895-d92fc4217e4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:00.184573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aba37-76ef-4045-8895-d92fc4217e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7f8aba37-76ef-4045-8895-d92fc4217e4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:00.190157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:00.191024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:00.191801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:00.196364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 192/369] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:00.197737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aba37-76ef-4045-8895-d92fc4217e4e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:00.252863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89fcc4-1d9a-42e0-bd2a-e8017566f8d0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:00.284967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:00.294163 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30668b-6676-450e-8cfe-8c80f2de5e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:00.295394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30668b-6676-450e-8cfe-8c80f2de5e1a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:00.295867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30668b-6676-450e-8cfe-8c80f2de5e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:00.296337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30668b-6676-450e-8cfe-8c80f2de5e1a None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:00.300448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30668b-6676-450e-8cfe-8c80f2de5e1a None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:00.300448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30668b-6676-450e-8cfe-8c80f2de5e1a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:00.302403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 178/370] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:00 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:00.303513 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30668b-6676-450e-8cfe-8c80f2de5e1a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:00.304112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:00.316720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aba37-76ef-4045-8895-d92fc4217e4e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:00.360757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd21db5-41d8-4913-a6c6-b0bc3b6a0ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:00.361291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd21db5-41d8-4913-a6c6-b0bc3b6a0ddf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:00.361610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd21db5-41d8-4913-a6c6-b0bc3b6a0ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:00.361884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd21db5-41d8-4913-a6c6-b0bc3b6a0ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:00.444694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30668b-6676-450e-8cfe-8c80f2de5e1a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:00.457787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd21db5-41d8-4913-a6c6-b0bc3b6a0ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:00.460654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd21db5-41d8-4913-a6c6-b0bc3b6a0ddf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:00.490663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bf14-b803-4289-9464-ea102da5e018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:00.491567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bf14-b803-4289-9464-ea102da5e018 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:00.492049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bf14-b803-4289-9464-ea102da5e018 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:00.492496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bf14-b803-4289-9464-ea102da5e018 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:00.493506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6bf14-b803-4289-9464-ea102da5e018 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:00.495163 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6bf14-b803-4289-9464-ea102da5e018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:00.497494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6bf14-b803-4289-9464-ea102da5e018 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:00.508591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 179/371] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:00.510215 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bf14-b803-4289-9464-ea102da5e018 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:00.571627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:00.584057 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:00.595495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 193/372] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:00.596399 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd21db5-41d8-4913-a6c6-b0bc3b6a0ddf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:00.617626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bf14-b803-4289-9464-ea102da5e018 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:00.677279 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270afaf6-c5c7-477e-b5aa-83f8a59ebed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:00.678029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270afaf6-c5c7-477e-b5aa-83f8a59ebed8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:00.678135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270afaf6-c5c7-477e-b5aa-83f8a59ebed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:00.678409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270afaf6-c5c7-477e-b5aa-83f8a59ebed8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:00.679131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270afaf6-c5c7-477e-b5aa-83f8a59ebed8 None admin] RBAC: Adding query filter params (group.id=827fa2529be14c41bb1d35fa652d4556, role.id=8941b3ff5a124d0a918ea79de7649945, scope.project.id=5e21e073540045728f2ced13ce6d6eea) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:00.679440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270afaf6-c5c7-477e-b5aa-83f8a59ebed8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:00.680927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270afaf6-c5c7-477e-b5aa-83f8a59ebed8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:00.688796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 180/373] 10.222.0.55 () {56 vars in 1376 bytes} [Fri Sep 2 09:13:00 2022] GET /identity/v3/role_assignments?group.id=827fa2529be14c41bb1d35fa652d4556&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:00.689948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270afaf6-c5c7-477e-b5aa-83f8a59ebed8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:00.721514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd21db5-41d8-4913-a6c6-b0bc3b6a0ddf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:00.765819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e9525-69eb-4cec-bc62-09c644da1d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:00.767010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9525-69eb-4cec-bc62-09c644da1d49 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:00.767485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9525-69eb-4cec-bc62-09c644da1d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:00.768501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9525-69eb-4cec-bc62-09c644da1d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:00.848892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:00.858747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e9525-69eb-4cec-bc62-09c644da1d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:00.860630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e9525-69eb-4cec-bc62-09c644da1d49 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:00.900922 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270afaf6-c5c7-477e-b5aa-83f8a59ebed8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:00.953091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:00.976189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabd23d-9892-46c7-81a2-02f3f031cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:00.976515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd23d-9892-46c7-81a2-02f3f031cb1a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:00.976769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd23d-9892-46c7-81a2-02f3f031cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:00.977043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd23d-9892-46c7-81a2-02f3f031cb1a None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:00.979386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabd23d-9892-46c7-81a2-02f3f031cb1a None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:00.980960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabd23d-9892-46c7-81a2-02f3f031cb1a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:00.982774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 181/374] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:00 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:00.984672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985a448-1c91-4c28-a6d3-b7961413f836 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:00.984956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985a448-1c91-4c28-a6d3-b7961413f836 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:00.985234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985a448-1c91-4c28-a6d3-b7961413f836 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:00.985748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 194/375] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:00.986871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 182/376] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:00.988957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e9525-69eb-4cec-bc62-09c644da1d49 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:00.998615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce0aae-04b8-4c39-9d6b-1afbc77444b7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:00.998896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce0aae-04b8-4c39-9d6b-1afbc77444b7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:00.999174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce0aae-04b8-4c39-9d6b-1afbc77444b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:01.025189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-38ce0aae-04b8-4c39-9d6b-1afbc77444b7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:01.027539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-38ce0aae-04b8-4c39-9d6b-1afbc77444b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:01.095684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:01.106726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e9525-69eb-4cec-bc62-09c644da1d49 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:01.123408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 183/377] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:13:01.128695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce0aae-04b8-4c39-9d6b-1afbc77444b7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:01.153152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c92b8-af49-44a8-8880-b8443cd51eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:01.153713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c92b8-af49-44a8-8880-b8443cd51eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:01.153990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c92b8-af49-44a8-8880-b8443cd51eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:01.154310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c92b8-af49-44a8-8880-b8443cd51eb7 None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:01.155479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c92b8-af49-44a8-8880-b8443cd51eb7 None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:01.157385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c92b8-af49-44a8-8880-b8443cd51eb7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:01.159482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 195/378] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:00 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:01.166724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c92b8-af49-44a8-8880-b8443cd51eb7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:01.271918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce0aae-04b8-4c39-9d6b-1afbc77444b7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:01.301488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:01.321558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c92b8-af49-44a8-8880-b8443cd51eb7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:01.324576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e787b0e-25f0-403c-9980-d08daadec559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:01.325236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e787b0e-25f0-403c-9980-d08daadec559 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:01.325589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e787b0e-25f0-403c-9980-d08daadec559 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:01.325867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e787b0e-25f0-403c-9980-d08daadec559 None admin] PATH_INFO: `/v3/projects/736e52eb4dfe4b01a672224315f6274a` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:01.327049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e787b0e-25f0-403c-9980-d08daadec559 None admin] RBAC: Authorizing `identity:get_project(project_id=736e52eb4dfe4b01a672224315f6274a)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:01.328542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e787b0e-25f0-403c-9980-d08daadec559 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:01.330254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 184/379] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:01 2022] GET /identity/v3/projects/736e52eb4dfe4b01a672224315f6274a => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:01.337267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e787b0e-25f0-403c-9980-d08daadec559 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:01.359737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3466b-bb6e-4ed9-8049-1129188c5d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:01.360752 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3466b-bb6e-4ed9-8049-1129188c5d8c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:01.361224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3466b-bb6e-4ed9-8049-1129188c5d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:01.361699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3466b-bb6e-4ed9-8049-1129188c5d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:01.362715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3466b-bb6e-4ed9-8049-1129188c5d8c None admin] RBAC: Adding query filter params (group.id=827fa2529be14c41bb1d35fa652d4556, role.id=5691b81a7afd45eca087af3298e82784, scope.project.id=5e21e073540045728f2ced13ce6d6eea) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:01.363300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3466b-bb6e-4ed9-8049-1129188c5d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:01.365248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3466b-bb6e-4ed9-8049-1129188c5d8c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:01.372077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 196/380] 10.222.0.55 () {56 vars in 1376 bytes} [Fri Sep 2 09:13:01 2022] GET /identity/v3/role_assignments?group.id=827fa2529be14c41bb1d35fa652d4556&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=5691b81a7afd45eca087af3298e82784 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:01.491709 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e787b0e-25f0-403c-9980-d08daadec559 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:01.529174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3466b-bb6e-4ed9-8049-1129188c5d8c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:01.533545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9be86a-ec7e-499b-9569-b040c3b0abd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:01.534200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be86a-ec7e-499b-9569-b040c3b0abd0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:01.534479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be86a-ec7e-499b-9569-b040c3b0abd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:01.534752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be86a-ec7e-499b-9569-b040c3b0abd0 None admin] PATH_INFO: `/v3/groups/843094af2dce4d059b6250ba99602491` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:01.542143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9be86a-ec7e-499b-9569-b040c3b0abd0 None admin] RBAC: Authorizing `identity:get_group(group_id=843094af2dce4d059b6250ba99602491)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:01.543646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9be86a-ec7e-499b-9569-b040c3b0abd0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:01.548426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 185/381] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:01 2022] GET /identity/v3/groups/843094af2dce4d059b6250ba99602491 => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:01.554331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9be86a-ec7e-499b-9569-b040c3b0abd0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:01.568571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:01.626263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:01.651783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3466b-bb6e-4ed9-8049-1129188c5d8c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:01.674522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9be86a-ec7e-499b-9569-b040c3b0abd0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:01.690383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e877d-da75-4aed-bc6e-4d2e48d3d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:01.691438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e877d-da75-4aed-bc6e-4d2e48d3d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:01.692013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e877d-da75-4aed-bc6e-4d2e48d3d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:01.693135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e877d-da75-4aed-bc6e-4d2e48d3d4f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:01.712223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e877d-da75-4aed-bc6e-4d2e48d3d4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a12e877d-da75-4aed-bc6e-4d2e48d3d4f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:01.719410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:01.720285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:13:01.721060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:01.727454 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 197/382] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:01.741828 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e877d-da75-4aed-bc6e-4d2e48d3d4f3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:01.749514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ac1d-ea30-4276-9ebf-776254f5d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:01.750473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ac1d-ea30-4276-9ebf-776254f5d00a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:01.750942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ac1d-ea30-4276-9ebf-776254f5d00a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:01.751403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ac1d-ea30-4276-9ebf-776254f5d00a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:01.752345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939ac1d-ea30-4276-9ebf-776254f5d00a None admin] RBAC: Adding query filter params (group.id=843094af2dce4d059b6250ba99602491, role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=736e52eb4dfe4b01a672224315f6274a) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:01.752843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939ac1d-ea30-4276-9ebf-776254f5d00a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:01.754498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939ac1d-ea30-4276-9ebf-776254f5d00a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:01.768002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 186/383] 10.222.0.55 () {56 vars in 1376 bytes} [Fri Sep 2 09:13:01 2022] GET /identity/v3/role_assignments?group.id=843094af2dce4d059b6250ba99602491&scope.project.id=736e52eb4dfe4b01a672224315f6274a&role.id=04d1bc62091440e189989e4b973a6627 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:01.844330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:01.860568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e877d-da75-4aed-bc6e-4d2e48d3d4f3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:01.897521 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56953d8-8fd5-4dd8-83cb-c594ef932dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:01.898146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56953d8-8fd5-4dd8-83cb-c594ef932dcf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:01.898421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56953d8-8fd5-4dd8-83cb-c594ef932dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:01.898691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56953d8-8fd5-4dd8-83cb-c594ef932dcf None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:01.899352 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56953d8-8fd5-4dd8-83cb-c594ef932dcf None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:01.899649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56953d8-8fd5-4dd8-83cb-c594ef932dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:01.901669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56953d8-8fd5-4dd8-83cb-c594ef932dcf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:01.911464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 198/384] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:13:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:01.917121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ac1d-ea30-4276-9ebf-776254f5d00a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:02.034071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ac1d-ea30-4276-9ebf-776254f5d00a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:02.057435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:02.083773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a3554-c7d5-41cc-b43d-81bdc12f3350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:02.084539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a3554-c7d5-41cc-b43d-81bdc12f3350 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:02.084821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a3554-c7d5-41cc-b43d-81bdc12f3350 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:02.085089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a3554-c7d5-41cc-b43d-81bdc12f3350 None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:02.086215 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a3554-c7d5-41cc-b43d-81bdc12f3350 None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:02.087728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a3554-c7d5-41cc-b43d-81bdc12f3350 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:02.090242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 187/385] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:01 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:02.096946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56953d8-8fd5-4dd8-83cb-c594ef932dcf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:02.210885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56953d8-8fd5-4dd8-83cb-c594ef932dcf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:02.246090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710d10e-6d95-4969-8d8e-f0fc27cc3cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:02.246725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710d10e-6d95-4969-8d8e-f0fc27cc3cad None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:02.247002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710d10e-6d95-4969-8d8e-f0fc27cc3cad None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:02.247271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710d10e-6d95-4969-8d8e-f0fc27cc3cad None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:02.248407 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710d10e-6d95-4969-8d8e-f0fc27cc3cad None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:02.249830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710d10e-6d95-4969-8d8e-f0fc27cc3cad None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:02.251754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 199/386] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:02 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:02.261321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a3554-c7d5-41cc-b43d-81bdc12f3350 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:02.275460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b47683-279c-4f97-8d6d-9a9bfd566339 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:02.275731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b47683-279c-4f97-8d6d-9a9bfd566339 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:02.276405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b47683-279c-4f97-8d6d-9a9bfd566339 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:02.278597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 200/387] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:13:02.282592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d15ec-ed47-474e-b765-7762b87742fd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:02.282867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d15ec-ed47-474e-b765-7762b87742fd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:02.283142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d15ec-ed47-474e-b765-7762b87742fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:02.302424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a96d15ec-ed47-474e-b765-7762b87742fd None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:02.303462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a96d15ec-ed47-474e-b765-7762b87742fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:02.311747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:02.423417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 201/388] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:13:02.439309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a3554-c7d5-41cc-b43d-81bdc12f3350 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:02.476043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b77cf-2a12-49f7-a070-80421d7ca42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:02.476710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b77cf-2a12-49f7-a070-80421d7ca42f None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:02.476987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b77cf-2a12-49f7-a070-80421d7ca42f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:02.477256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b77cf-2a12-49f7-a070-80421d7ca42f None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/groups/827fa2529be14c41bb1d35fa652d4556/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:02.479217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b77cf-2a12-49f7-a070-80421d7ca42f None admin] RBAC: Authorizing `identity:create_grant(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6, group_id=827fa2529be14c41bb1d35fa652d4556, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:02.480735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b77cf-2a12-49f7-a070-80421d7ca42f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:02.565848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 188/389] 10.222.0.55 () {58 vars in 1442 bytes} [Fri Sep 2 09:13:02 2022] PUT /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/groups/827fa2529be14c41bb1d35fa652d4556/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:13:02.775826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d15ec-ed47-474e-b765-7762b87742fd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:02.893140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d15ec-ed47-474e-b765-7762b87742fd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:02.934562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2e7bf-6706-4e9c-8d10-0732947d5e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:02.935199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2e7bf-6706-4e9c-8d10-0732947d5e85 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:02.935473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2e7bf-6706-4e9c-8d10-0732947d5e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:02.935737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2e7bf-6706-4e9c-8d10-0732947d5e85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:02.946257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2e7bf-6706-4e9c-8d10-0732947d5e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-22b2e7bf-6706-4e9c-8d10-0732947d5e85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:02.952074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:02.952948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:02.953737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 202/390] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:13:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:02.959482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b77cf-2a12-49f7-a070-80421d7ca42f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:03.030085 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072480d8-2c5f-4e66-9f13-9149c997fee9 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:03.030403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072480d8-2c5f-4e66-9f13-9149c997fee9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:03.030636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072480d8-2c5f-4e66-9f13-9149c997fee9 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:03.032526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 203/391] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:03.037278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7eba-7807-43e3-b685-19d75e86c100 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:03.037551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7eba-7807-43e3-b685-19d75e86c100 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:03.037826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7eba-7807-43e3-b685-19d75e86c100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:03.043864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:03.046271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:03.062632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-71dd7eba-7807-43e3-b685-19d75e86c100 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:03.065366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-71dd7eba-7807-43e3-b685-19d75e86c100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:03.149544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b77cf-2a12-49f7-a070-80421d7ca42f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:03.202624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 204/392] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:13:03.207058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98bca8-dbe2-40f7-8600-694c33265867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:03.207918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98bca8-dbe2-40f7-8600-694c33265867 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:03.208394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98bca8-dbe2-40f7-8600-694c33265867 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:03.208855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98bca8-dbe2-40f7-8600-694c33265867 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:03.209713 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98bca8-dbe2-40f7-8600-694c33265867 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:03.210223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98bca8-dbe2-40f7-8600-694c33265867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:03.211788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98bca8-dbe2-40f7-8600-694c33265867 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:03.221760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 189/393] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:03.226964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7eba-7807-43e3-b685-19d75e86c100 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:03.333125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7eba-7807-43e3-b685-19d75e86c100 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:03.372269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:03.379773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842dccf-4928-4125-9abd-e56e21339848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:03.380811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842dccf-4928-4125-9abd-e56e21339848 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:03.381563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842dccf-4928-4125-9abd-e56e21339848 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:03.382091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842dccf-4928-4125-9abd-e56e21339848 None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:03.383563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842dccf-4928-4125-9abd-e56e21339848 None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:03.385831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842dccf-4928-4125-9abd-e56e21339848 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:03.388019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 205/394] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:03 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:03.394114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98bca8-dbe2-40f7-8600-694c33265867 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:03.520947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98bca8-dbe2-40f7-8600-694c33265867 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:03.534786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:03.559311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842dccf-4928-4125-9abd-e56e21339848 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:03.571597 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e82069-8f87-42d8-9d55-e07b337143be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:03.573733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e82069-8f87-42d8-9d55-e07b337143be None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:03.574197 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e82069-8f87-42d8-9d55-e07b337143be None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:03.574644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e82069-8f87-42d8-9d55-e07b337143be None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:03.576442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e82069-8f87-42d8-9d55-e07b337143be None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:03.578166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e82069-8f87-42d8-9d55-e07b337143be None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:03.580131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 190/395] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:03 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:03.590112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e82069-8f87-42d8-9d55-e07b337143be None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:03.671771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842dccf-4928-4125-9abd-e56e21339848 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:03.708105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518586-21ca-4cd2-99dd-6dc81006008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:03.708736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518586-21ca-4cd2-99dd-6dc81006008a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:03.709014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518586-21ca-4cd2-99dd-6dc81006008a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:03.709283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518586-21ca-4cd2-99dd-6dc81006008a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:03.723988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518586-21ca-4cd2-99dd-6dc81006008a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ff518586-21ca-4cd2-99dd-6dc81006008a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:03.725362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:03.726237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:03.727013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 206/396] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:03.732370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518586-21ca-4cd2-99dd-6dc81006008a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:03.766615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e82069-8f87-42d8-9d55-e07b337143be None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:03.794334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:03.832405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c52d9-d876-4bf8-b9ad-58c7f192099c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:03.833347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c52d9-d876-4bf8-b9ad-58c7f192099c None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:03.833765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c52d9-d876-4bf8-b9ad-58c7f192099c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:03.834228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c52d9-d876-4bf8-b9ad-58c7f192099c None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/groups/827fa2529be14c41bb1d35fa652d4556/roles/5691b81a7afd45eca087af3298e82784` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:03.844884 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c52d9-d876-4bf8-b9ad-58c7f192099c None admin] RBAC: Authorizing `identity:create_grant(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6, group_id=827fa2529be14c41bb1d35fa652d4556, role_id=5691b81a7afd45eca087af3298e82784)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:03.847409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c52d9-d876-4bf8-b9ad-58c7f192099c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:03.868530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518586-21ca-4cd2-99dd-6dc81006008a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:03.908167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb19728-0341-4cb5-9e43-6eba2af0661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:03.909215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb19728-0341-4cb5-9e43-6eba2af0661f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:03.909673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb19728-0341-4cb5-9e43-6eba2af0661f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:03.910080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb19728-0341-4cb5-9e43-6eba2af0661f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:03.910871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb19728-0341-4cb5-9e43-6eba2af0661f None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:03.911307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb19728-0341-4cb5-9e43-6eba2af0661f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:03.912878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb19728-0341-4cb5-9e43-6eba2af0661f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:03.921852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 207/397] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:13:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:03.928181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb19728-0341-4cb5-9e43-6eba2af0661f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:03.950374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 191/398] 10.222.0.55 () {58 vars in 1442 bytes} [Fri Sep 2 09:13:03 2022] PUT /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6/groups/827fa2529be14c41bb1d35fa652d4556/roles/5691b81a7afd45eca087af3298e82784 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:13:03.966081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d339a-df7a-4e2b-9dfd-6f849b9755cd None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:03.966505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d339a-df7a-4e2b-9dfd-6f849b9755cd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:03.966849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d339a-df7a-4e2b-9dfd-6f849b9755cd None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:03.968604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 192/399] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:03.977451 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0134-6b82-4ece-b3d4-28f117b20abc None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:03.977871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0134-6b82-4ece-b3d4-28f117b20abc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:03.978249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0134-6b82-4ece-b3d4-28f117b20abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:04.014054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-bdfc0134-6b82-4ece-b3d4-28f117b20abc None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:04.015291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bdfc0134-6b82-4ece-b3d4-28f117b20abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:04.086194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:04.116512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb19728-0341-4cb5-9e43-6eba2af0661f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:04.152169 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:04.169433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 193/400] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:13:04.169770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75263a45-12c4-4294-97b7-26c13fc40bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:04.170187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263a45-12c4-4294-97b7-26c13fc40bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:04.170462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263a45-12c4-4294-97b7-26c13fc40bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:04.170789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263a45-12c4-4294-97b7-26c13fc40bd8 None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:04.171938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75263a45-12c4-4294-97b7-26c13fc40bd8 None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:04.173395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75263a45-12c4-4294-97b7-26c13fc40bd8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:04.175191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 208/401] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:03 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:04.180654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc0134-6b82-4ece-b3d4-28f117b20abc None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:04.330294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc0134-6b82-4ece-b3d4-28f117b20abc None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:04.379619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1dae5-1b8b-43f3-85f2-e80d7d74bd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:04.380602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1dae5-1b8b-43f3-85f2-e80d7d74bd2b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:04.381060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1dae5-1b8b-43f3-85f2-e80d7d74bd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:04.381491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1dae5-1b8b-43f3-85f2-e80d7d74bd2b None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:04.382939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1dae5-1b8b-43f3-85f2-e80d7d74bd2b None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:04.384614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1dae5-1b8b-43f3-85f2-e80d7d74bd2b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:04.387466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 194/402] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:04 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:04.396929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75263a45-12c4-4294-97b7-26c13fc40bd8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:04.446951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1dae5-1b8b-43f3-85f2-e80d7d74bd2b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:04.511023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:04.523342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75263a45-12c4-4294-97b7-26c13fc40bd8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:04.567465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47d478-591b-4002-a560-d8213e8e5f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:04.568500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47d478-591b-4002-a560-d8213e8e5f64 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:04.568996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47d478-591b-4002-a560-d8213e8e5f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:04.569457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47d478-591b-4002-a560-d8213e8e5f64 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea/groups/827fa2529be14c41bb1d35fa652d4556/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:04.571555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47d478-591b-4002-a560-d8213e8e5f64 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e21e073540045728f2ced13ce6d6eea, group_id=827fa2529be14c41bb1d35fa652d4556, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:04.574038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47d478-591b-4002-a560-d8213e8e5f64 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:04.616553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1dae5-1b8b-43f3-85f2-e80d7d74bd2b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:04.658658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfddf77-335f-4818-98d9-b397a28db17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:04.659222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfddf77-335f-4818-98d9-b397a28db17e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:04.659500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfddf77-335f-4818-98d9-b397a28db17e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:04.659773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfddf77-335f-4818-98d9-b397a28db17e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:04.672368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfddf77-335f-4818-98d9-b397a28db17e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:04.677691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 209/403] 10.222.0.55 () {58 vars in 1442 bytes} [Fri Sep 2 09:13:04 2022] PUT /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea/groups/827fa2529be14c41bb1d35fa652d4556/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3bfddf77-335f-4818-98d9-b397a28db17e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:04.677850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:04.678714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:04.679515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 195/404] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:13:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:04.684997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfddf77-335f-4818-98d9-b397a28db17e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:04.761615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c72d-ee5f-43fd-ad52-6c7a68aed46f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:04.761952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c72d-ee5f-43fd-ad52-6c7a68aed46f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:04.762164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c72d-ee5f-43fd-ad52-6c7a68aed46f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:04.763926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 210/405] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:13:04.769220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe59a4d-4b9c-405d-a2a9-ce19c96ee925 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:04.769495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe59a4d-4b9c-405d-a2a9-ce19c96ee925 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:04.769766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe59a4d-4b9c-405d-a2a9-ce19c96ee925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:04.788927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ebe59a4d-4b9c-405d-a2a9-ce19c96ee925 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:04.790133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ebe59a4d-4b9c-405d-a2a9-ce19c96ee925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:04.799857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:04.809731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfddf77-335f-4818-98d9-b397a28db17e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:04.852317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:04.865885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bc0f4-51bf-454a-affe-7c8705212fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:04.866636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bc0f4-51bf-454a-affe-7c8705212fce None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:04.866973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bc0f4-51bf-454a-affe-7c8705212fce None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:04.867301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bc0f4-51bf-454a-affe-7c8705212fce None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:04.868091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bc0f4-51bf-454a-affe-7c8705212fce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:04.868449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bc0f4-51bf-454a-affe-7c8705212fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:04.870945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bc0f4-51bf-454a-affe-7c8705212fce None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:04.881045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 196/406] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:04.889380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bc0f4-51bf-454a-affe-7c8705212fce None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:04.905996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 211/407] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:05.012800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bc0f4-51bf-454a-affe-7c8705212fce None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:05.055228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c563cb-1eef-4784-b0f9-8dcc61c5a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:05.056165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c563cb-1eef-4784-b0f9-8dcc61c5a104 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:05.056634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c563cb-1eef-4784-b0f9-8dcc61c5a104 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:05.057056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c563cb-1eef-4784-b0f9-8dcc61c5a104 None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:05.058330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c563cb-1eef-4784-b0f9-8dcc61c5a104 None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:05.060003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c563cb-1eef-4784-b0f9-8dcc61c5a104 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:05.061733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 197/408] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:04 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:05.067304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe59a4d-4b9c-405d-a2a9-ce19c96ee925 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:05.195129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe59a4d-4b9c-405d-a2a9-ce19c96ee925 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:05.230387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c316a8-8b54-4527-8006-e124e57c795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:05.231079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c316a8-8b54-4527-8006-e124e57c795b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:05.231354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c316a8-8b54-4527-8006-e124e57c795b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:05.231621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c316a8-8b54-4527-8006-e124e57c795b None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:05.232765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c316a8-8b54-4527-8006-e124e57c795b None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:05.234199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c316a8-8b54-4527-8006-e124e57c795b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:05.236130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 212/409] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:05 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:05.241981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c563cb-1eef-4784-b0f9-8dcc61c5a104 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:05.267299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d70e5c-be3f-4c8e-87e0-109ac7dd3a6d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:05.267498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d70e5c-be3f-4c8e-87e0-109ac7dd3a6d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:05.267770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d70e5c-be3f-4c8e-87e0-109ac7dd3a6d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:05.269379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 213/410] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:05.280208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:05.283732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c2240-3f3b-4a58-9dbd-c2c9ebb09d2e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:05.284035 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c2240-3f3b-4a58-9dbd-c2c9ebb09d2e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:05.284305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c2240-3f3b-4a58-9dbd-c2c9ebb09d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:05.320934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-575c2240-3f3b-4a58-9dbd-c2c9ebb09d2e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:05.322132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-575c2240-3f3b-4a58-9dbd-c2c9ebb09d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:05.368848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:05.370682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c563cb-1eef-4784-b0f9-8dcc61c5a104 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:05.394002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 214/411] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 02 09:13:05.400938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c2240-3f3b-4a58-9dbd-c2c9ebb09d2e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:05.407968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697170c-359e-409b-a757-b8a42eb5bf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:05.408721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697170c-359e-409b-a757-b8a42eb5bf00 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:05.409058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697170c-359e-409b-a757-b8a42eb5bf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:05.409398 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697170c-359e-409b-a757-b8a42eb5bf00 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea/groups/827fa2529be14c41bb1d35fa652d4556/roles/5691b81a7afd45eca087af3298e82784` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:05.411667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697170c-359e-409b-a757-b8a42eb5bf00 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e21e073540045728f2ced13ce6d6eea, group_id=827fa2529be14c41bb1d35fa652d4556, role_id=5691b81a7afd45eca087af3298e82784)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:05.413233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697170c-359e-409b-a757-b8a42eb5bf00 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:05.520923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c2240-3f3b-4a58-9dbd-c2c9ebb09d2e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:05.523498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 198/412] 10.222.0.55 () {58 vars in 1442 bytes} [Fri Sep 2 09:13:05 2022] PUT /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea/groups/827fa2529be14c41bb1d35fa652d4556/roles/5691b81a7afd45eca087af3298e82784 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:13:05.560129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea8d6c-92d9-4cac-9dbf-ca659ec6c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:05.560880 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8d6c-92d9-4cac-9dbf-ca659ec6c122 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:05.561235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8d6c-92d9-4cac-9dbf-ca659ec6c122 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:05.561578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8d6c-92d9-4cac-9dbf-ca659ec6c122 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:05.574580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea8d6c-92d9-4cac-9dbf-ca659ec6c122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-62ea8d6c-92d9-4cac-9dbf-ca659ec6c122 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:05.579839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:05.580996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:05.581961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:05.583819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 215/413] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:05.588840 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697170c-359e-409b-a757-b8a42eb5bf00 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:05.729146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:05.750140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697170c-359e-409b-a757-b8a42eb5bf00 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:05.789361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dda38-4a20-4974-8ebc-b4e4f01b850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:05.789579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea8d6c-92d9-4cac-9dbf-ca659ec6c122 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:05.789974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dda38-4a20-4974-8ebc-b4e4f01b850c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:05.790247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dda38-4a20-4974-8ebc-b4e4f01b850c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:05.790514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dda38-4a20-4974-8ebc-b4e4f01b850c None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:05.791710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dda38-4a20-4974-8ebc-b4e4f01b850c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:05.792047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dda38-4a20-4974-8ebc-b4e4f01b850c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:05.793427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dda38-4a20-4974-8ebc-b4e4f01b850c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:05.802636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 199/414] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:05.810259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dda38-4a20-4974-8ebc-b4e4f01b850c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:05.871245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:05.926075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dda38-4a20-4974-8ebc-b4e4f01b850c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:05.962447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe12cab-05c7-45bd-9c3d-f417b6a800ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:05.964077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12cab-05c7-45bd-9c3d-f417b6a800ab None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:05.964545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12cab-05c7-45bd-9c3d-f417b6a800ab None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:05.965017 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12cab-05c7-45bd-9c3d-f417b6a800ab None admin] PATH_INFO: `/v3/groups/843094af2dce4d059b6250ba99602491` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:05.966324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe12cab-05c7-45bd-9c3d-f417b6a800ab None admin] RBAC: Authorizing `identity:get_group(group_id=843094af2dce4d059b6250ba99602491)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:05.967978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe12cab-05c7-45bd-9c3d-f417b6a800ab None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:05.970104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 200/415] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:05 2022] GET /identity/v3/groups/843094af2dce4d059b6250ba99602491 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:05.975569 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe12cab-05c7-45bd-9c3d-f417b6a800ab None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:05.989987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea8d6c-92d9-4cac-9dbf-ca659ec6c122 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:05.993096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:06.083740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe12cab-05c7-45bd-9c3d-f417b6a800ab None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:06.101203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4632d36-bd70-48ed-89fa-43d4f776fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:06.101826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4632d36-bd70-48ed-89fa-43d4f776fcae None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:06.102101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4632d36-bd70-48ed-89fa-43d4f776fcae None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:06.102364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4632d36-bd70-48ed-89fa-43d4f776fcae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:06.123969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de85ba-8bca-4ecd-9fae-c72530b24336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:06.125209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de85ba-8bca-4ecd-9fae-c72530b24336 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:06.125718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de85ba-8bca-4ecd-9fae-c72530b24336 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:06.126214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de85ba-8bca-4ecd-9fae-c72530b24336 None admin] PATH_INFO: `/v3/projects/736e52eb4dfe4b01a672224315f6274a` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:06.127522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de85ba-8bca-4ecd-9fae-c72530b24336 None admin] RBAC: Authorizing `identity:get_project(project_id=736e52eb4dfe4b01a672224315f6274a)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:06.129168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de85ba-8bca-4ecd-9fae-c72530b24336 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:06.131037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 201/416] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:05 2022] GET /identity/v3/projects/736e52eb4dfe4b01a672224315f6274a => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:06.134512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4632d36-bd70-48ed-89fa-43d4f776fcae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:06.137188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de85ba-8bca-4ecd-9fae-c72530b24336 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f4632d36-bd70-48ed-89fa-43d4f776fcae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:06.139414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:06.140306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:06.141095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 216/417] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:06.148822 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4632d36-bd70-48ed-89fa-43d4f776fcae None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:06.227542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:06.247535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de85ba-8bca-4ecd-9fae-c72530b24336 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:06.282336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b4387-5151-4e63-a6e2-00d61a8f350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:06.283356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4387-5151-4e63-a6e2-00d61a8f350e None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:06.283825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4387-5151-4e63-a6e2-00d61a8f350e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:06.284308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4387-5151-4e63-a6e2-00d61a8f350e None admin] PATH_INFO: `/v3/projects/736e52eb4dfe4b01a672224315f6274a/groups/843094af2dce4d059b6250ba99602491/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:06.286765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b4387-5151-4e63-a6e2-00d61a8f350e None admin] RBAC: Authorizing `identity:create_grant(project_id=736e52eb4dfe4b01a672224315f6274a, group_id=843094af2dce4d059b6250ba99602491, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:06.290326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b4387-5151-4e63-a6e2-00d61a8f350e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:06.330501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:06.335482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4632d36-bd70-48ed-89fa-43d4f776fcae None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:06.369261 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 202/418] 10.222.0.55 () {58 vars in 1442 bytes} [Fri Sep 2 09:13:06 2022] PUT /identity/v3/projects/736e52eb4dfe4b01a672224315f6274a/groups/843094af2dce4d059b6250ba99602491/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:13:06.370986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46828242-a05e-4a09-af26-2abb2c7dc6ae None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:06.371463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46828242-a05e-4a09-af26-2abb2c7dc6ae None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:06.372339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46828242-a05e-4a09-af26-2abb2c7dc6ae None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:06.379309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244a2bb-da64-48d9-88d9-3715c994bc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:06.379309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a2bb-da64-48d9-88d9-3715c994bc6b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:06.379309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a2bb-da64-48d9-88d9-3715c994bc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:06.379309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a2bb-da64-48d9-88d9-3715c994bc6b None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:06.379646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244a2bb-da64-48d9-88d9-3715c994bc6b None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:06.379646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244a2bb-da64-48d9-88d9-3715c994bc6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:06.379646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244a2bb-da64-48d9-88d9-3715c994bc6b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:06.380424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 203/419] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:06.382050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7841f5-0ff7-4395-8fea-0d5a3b906b26 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:06.382547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7841f5-0ff7-4395-8fea-0d5a3b906b26 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:06.383085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7841f5-0ff7-4395-8fea-0d5a3b906b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:06.399959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 217/420] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:13:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:06.405400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244a2bb-da64-48d9-88d9-3715c994bc6b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:06.421104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6d7841f5-0ff7-4395-8fea-0d5a3b906b26 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:06.422324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6d7841f5-0ff7-4395-8fea-0d5a3b906b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:06.526161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244a2bb-da64-48d9-88d9-3715c994bc6b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:06.562690 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9d5e3-01cd-4a0e-b1d2-4d15dcd89373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:06.563647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9d5e3-01cd-4a0e-b1d2-4d15dcd89373 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:06.564054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 204/421] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:06.564344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9d5e3-01cd-4a0e-b1d2-4d15dcd89373 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:06.564620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9d5e3-01cd-4a0e-b1d2-4d15dcd89373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:06.602375 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:06.643959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9d5e3-01cd-4a0e-b1d2-4d15dcd89373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:06.645429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9d5e3-01cd-4a0e-b1d2-4d15dcd89373 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:06.763746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 218/422] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:06.769595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7841f5-0ff7-4395-8fea-0d5a3b906b26 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:06.848312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:06.879261 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7841f5-0ff7-4395-8fea-0d5a3b906b26 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:06.916372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9b12b-17c7-4408-a629-7d2dfdc52015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:06.917004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9b12b-17c7-4408-a629-7d2dfdc52015 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:06.917283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9b12b-17c7-4408-a629-7d2dfdc52015 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:06.917555 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9b12b-17c7-4408-a629-7d2dfdc52015 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:06.918752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9b12b-17c7-4408-a629-7d2dfdc52015 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:06.920511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9b12b-17c7-4408-a629-7d2dfdc52015 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:06.922505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 205/423] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:06 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:06.928985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9d5e3-01cd-4a0e-b1d2-4d15dcd89373 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:07.020292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:07.042047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9b12b-17c7-4408-a629-7d2dfdc52015 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:07.074901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9d5e3-01cd-4a0e-b1d2-4d15dcd89373 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:07.121674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e1a3c-d15c-4851-bcb6-edf2c504e7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:07.122416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e1a3c-d15c-4851-bcb6-edf2c504e7fc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:07.122743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e1a3c-d15c-4851-bcb6-edf2c504e7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:07.123125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e1a3c-d15c-4851-bcb6-edf2c504e7fc None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:07.124282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e1a3c-d15c-4851-bcb6-edf2c504e7fc None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:07.125823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e1a3c-d15c-4851-bcb6-edf2c504e7fc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:07.127816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 219/424] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:06 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:07.129090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c015f-a109-40b0-a8d2-08f5edfbb455 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:07.129421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c015f-a109-40b0-a8d2-08f5edfbb455 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:07.129743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c015f-a109-40b0-a8d2-08f5edfbb455 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:07.131320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 220/425] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:07.136856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c015f-a109-40b0-a8d2-08f5edfbb455 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:07.165602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9b12b-17c7-4408-a629-7d2dfdc52015 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:07.201599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9fb4e-adf9-4373-b294-4472fa7b0bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:07.202231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9fb4e-adf9-4373-b294-4472fa7b0bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:07.202510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9fb4e-adf9-4373-b294-4472fa7b0bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:07.202793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9fb4e-adf9-4373-b294-4472fa7b0bb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:07.211238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:07.214645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9fb4e-adf9-4373-b294-4472fa7b0bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-91b9fb4e-adf9-4373-b294-4472fa7b0bb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:07.220238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:07.221186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:07.221955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 206/426] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:13:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:07.223762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48192d6a-9691-4e46-8dda-a1acb5d46898 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:07.224000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48192d6a-9691-4e46-8dda-a1acb5d46898 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:07.224274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48192d6a-9691-4e46-8dda-a1acb5d46898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:07.242438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-48192d6a-9691-4e46-8dda-a1acb5d46898 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:07.243627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-48192d6a-9691-4e46-8dda-a1acb5d46898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:07.274930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c015f-a109-40b0-a8d2-08f5edfbb455 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:07.312260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:07.321856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 207/427] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:07.323126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48192d6a-9691-4e46-8dda-a1acb5d46898 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:07.323528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdff99f-075c-4a9f-b469-ec2518be5b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:07.327915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff99f-075c-4a9f-b469-ec2518be5b2f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:07.327915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff99f-075c-4a9f-b469-ec2518be5b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:07.327915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff99f-075c-4a9f-b469-ec2518be5b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:07.327915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdff99f-075c-4a9f-b469-ec2518be5b2f None admin] RBAC: Adding query filter params (group.id=827fa2529be14c41bb1d35fa652d4556, role.id=8941b3ff5a124d0a918ea79de7649945, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:07.327915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdff99f-075c-4a9f-b469-ec2518be5b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:07.327915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdff99f-075c-4a9f-b469-ec2518be5b2f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:07.338438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 221/428] 10.222.0.55 () {56 vars in 1376 bytes} [Fri Sep 2 09:13:07 2022] GET /identity/v3/role_assignments?group.id=827fa2529be14c41bb1d35fa652d4556&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:07.462841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48192d6a-9691-4e46-8dda-a1acb5d46898 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:07.495285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:07.507648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf53d7-8f79-4e00-9e9f-bbf658ca2479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:07.513365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf53d7-8f79-4e00-9e9f-bbf658ca2479 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:07.513365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf53d7-8f79-4e00-9e9f-bbf658ca2479 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:07.513365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf53d7-8f79-4e00-9e9f-bbf658ca2479 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:07.513365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf53d7-8f79-4e00-9e9f-bbf658ca2479 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:07.513365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf53d7-8f79-4e00-9e9f-bbf658ca2479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:07.513365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf53d7-8f79-4e00-9e9f-bbf658ca2479 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:07.524038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 208/429] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:07.530161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdff99f-075c-4a9f-b469-ec2518be5b2f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:07.652935 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdff99f-075c-4a9f-b469-ec2518be5b2f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:07.691518 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadd955-7988-4f11-9bd8-48bfb5702308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:07.692163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd955-7988-4f11-9bd8-48bfb5702308 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:07.692446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd955-7988-4f11-9bd8-48bfb5702308 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:07.692719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd955-7988-4f11-9bd8-48bfb5702308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:07.734564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62cb13-2c1a-4afc-b020-7dd4c8ed2e98 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:07.734854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62cb13-2c1a-4afc-b020-7dd4c8ed2e98 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:07.735104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62cb13-2c1a-4afc-b020-7dd4c8ed2e98 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:07.738519 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 209/430] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:13:07.747673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bfa8-d1d9-4225-95ed-748dc1181703 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:07.747989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bfa8-d1d9-4225-95ed-748dc1181703 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:07.748270 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bfa8-d1d9-4225-95ed-748dc1181703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:07.766146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:07.771981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e0f5bfa8-d1d9-4225-95ed-748dc1181703 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:07.773272 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e0f5bfa8-d1d9-4225-95ed-748dc1181703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:07.776140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadd955-7988-4f11-9bd8-48bfb5702308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:07.777910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadd955-7988-4f11-9bd8-48bfb5702308 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:07.862715 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 210/431] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:07.863570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5bfa8-d1d9-4225-95ed-748dc1181703 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:07.904273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 222/432] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:07.913126 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadd955-7988-4f11-9bd8-48bfb5702308 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:07.975103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5bfa8-d1d9-4225-95ed-748dc1181703 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:08.002469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:08.016800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef3531-4731-45b3-8697-ea3d40feb490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:08.022778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef3531-4731-45b3-8697-ea3d40feb490 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.022778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef3531-4731-45b3-8697-ea3d40feb490 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.022778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef3531-4731-45b3-8697-ea3d40feb490 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.030349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:08.032651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef3531-4731-45b3-8697-ea3d40feb490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d5ef3531-4731-45b3-8697-ea3d40feb490 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:08.039534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:08.040424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:08.041250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 211/433] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:08.045714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadd955-7988-4f11-9bd8-48bfb5702308 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:08.057086 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef3531-4731-45b3-8697-ea3d40feb490 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:08.090758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae893fae-e908-4150-b4e0-9da6d3c3ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:08.092569 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893fae-e908-4150-b4e0-9da6d3c3ef48 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.093054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893fae-e908-4150-b4e0-9da6d3c3ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.093521 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893fae-e908-4150-b4e0-9da6d3c3ef48 None admin] PATH_INFO: `/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.094871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae893fae-e908-4150-b4e0-9da6d3c3ef48 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8ab3370fd4f32bc703001ac1cb5b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:08.096915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae893fae-e908-4150-b4e0-9da6d3c3ef48 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:08.098743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 223/434] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:07 2022] GET /identity/v3/projects/d2a8ab3370fd4f32bc703001ac1cb5b6 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:08.104980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae893fae-e908-4150-b4e0-9da6d3c3ef48 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:08.181582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef3531-4731-45b3-8697-ea3d40feb490 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:08.219027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440608b-6bf6-4c59-91e6-c20175b6a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:08.219631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440608b-6bf6-4c59-91e6-c20175b6a120 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.219923 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440608b-6bf6-4c59-91e6-c20175b6a120 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.220196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440608b-6bf6-4c59-91e6-c20175b6a120 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.220848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440608b-6bf6-4c59-91e6-c20175b6a120 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:08.221141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440608b-6bf6-4c59-91e6-c20175b6a120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:08.222501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440608b-6bf6-4c59-91e6-c20175b6a120 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:08.230937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 212/435] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:13:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:08.231548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440608b-6bf6-4c59-91e6-c20175b6a120 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:08.234500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae893fae-e908-4150-b4e0-9da6d3c3ef48 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:08.276029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5bdab-b49f-46b1-884a-75d52d806ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:08.276660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bdab-b49f-46b1-884a-75d52d806ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.276935 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bdab-b49f-46b1-884a-75d52d806ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.277389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bdab-b49f-46b1-884a-75d52d806ae8 None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.278345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5bdab-b49f-46b1-884a-75d52d806ae8 None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:08.279731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5bdab-b49f-46b1-884a-75d52d806ae8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:08.280319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:08.281348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 224/436] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:08 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:08.286993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5bdab-b49f-46b1-884a-75d52d806ae8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:08.318153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:08.338789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440608b-6bf6-4c59-91e6-c20175b6a120 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:08.375931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348afc5-044c-4b33-b892-f042f4079b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:08.376567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348afc5-044c-4b33-b892-f042f4079b9d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.376846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348afc5-044c-4b33-b892-f042f4079b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.377125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348afc5-044c-4b33-b892-f042f4079b9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.388139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348afc5-044c-4b33-b892-f042f4079b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1348afc5-044c-4b33-b892-f042f4079b9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:08.393577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:08.394484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:13:08.395386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:08.396711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5bdab-b49f-46b1-884a-75d52d806ae8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:08.396790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 213/437] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:13:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:08.396790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348afc5-044c-4b33-b892-f042f4079b9d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:08.436553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822fae8-9712-4361-b811-622f2005d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:08.437161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822fae8-9712-4361-b811-622f2005d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.437440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822fae8-9712-4361-b811-622f2005d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.437714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822fae8-9712-4361-b811-622f2005d7e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.504820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348afc5-044c-4b33-b892-f042f4079b9d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:08.507281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:08.510625 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822fae8-9712-4361-b811-622f2005d7e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:08.512127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822fae8-9712-4361-b811-622f2005d7e9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:08.538787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:08.539984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330abb-52d3-4af2-87f0-f847ddcb4b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:08.540808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330abb-52d3-4af2-87f0-f847ddcb4b5f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.541090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330abb-52d3-4af2-87f0-f847ddcb4b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.541392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330abb-52d3-4af2-87f0-f847ddcb4b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.542168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3330abb-52d3-4af2-87f0-f847ddcb4b5f None admin] RBAC: Adding query filter params (group.id=827fa2529be14c41bb1d35fa652d4556, role.id=5691b81a7afd45eca087af3298e82784, scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:08.542487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3330abb-52d3-4af2-87f0-f847ddcb4b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:08.543939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3330abb-52d3-4af2-87f0-f847ddcb4b5f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:08.549985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 214/438] 10.222.0.55 () {56 vars in 1376 bytes} [Fri Sep 2 09:13:08 2022] GET /identity/v3/role_assignments?group.id=827fa2529be14c41bb1d35fa652d4556&scope.project.id=d2a8ab3370fd4f32bc703001ac1cb5b6&role.id=5691b81a7afd45eca087af3298e82784 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:08.551268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330abb-52d3-4af2-87f0-f847ddcb4b5f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:08.636255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 225/439] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:08.643961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822fae8-9712-4361-b811-622f2005d7e9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:08.694165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330abb-52d3-4af2-87f0-f847ddcb4b5f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:08.738778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187faa8d-1642-4079-a9df-c9722f20b6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:08.739388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187faa8d-1642-4079-a9df-c9722f20b6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.739658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187faa8d-1642-4079-a9df-c9722f20b6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.739952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187faa8d-1642-4079-a9df-c9722f20b6e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.740869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187faa8d-1642-4079-a9df-c9722f20b6e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:08.741162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187faa8d-1642-4079-a9df-c9722f20b6e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:08.742535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187faa8d-1642-4079-a9df-c9722f20b6e6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:08.753605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 215/440] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:08.753778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb29ee-061d-4fac-a69e-5f4fea728218 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.754065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb29ee-061d-4fac-a69e-5f4fea728218 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.754337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb29ee-061d-4fac-a69e-5f4fea728218 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.755736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 216/441] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:08.757898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822fae8-9712-4361-b811-622f2005d7e9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:08.761131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aae9c-1905-4d3f-abcc-3f09710834d8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.761477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aae9c-1905-4d3f-abcc-3f09710834d8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.761759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aae9c-1905-4d3f-abcc-3f09710834d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.781543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3c1aae9c-1905-4d3f-abcc-3f09710834d8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:08.782744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3c1aae9c-1905-4d3f-abcc-3f09710834d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:08.791670 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:08.799934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3ef8c-56fb-4960-b685-81dd472f6343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:08.800573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3ef8c-56fb-4960-b685-81dd472f6343 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.801246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3ef8c-56fb-4960-b685-81dd472f6343 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.801246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3ef8c-56fb-4960-b685-81dd472f6343 None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.802215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3ef8c-56fb-4960-b685-81dd472f6343 None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:08.803659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3ef8c-56fb-4960-b685-81dd472f6343 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:08.805643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 226/442] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:08 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:08.806617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3ef8c-56fb-4960-b685-81dd472f6343 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:08.812028 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:08.866690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 217/443] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:13:08.867550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aae9c-1905-4d3f-abcc-3f09710834d8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:08.920373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3ef8c-56fb-4960-b685-81dd472f6343 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:08.961282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa4e07-0233-4de1-a3d5-8f236364f1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:08.961886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa4e07-0233-4de1-a3d5-8f236364f1de None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:08.962160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa4e07-0233-4de1-a3d5-8f236364f1de None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:08.962429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa4e07-0233-4de1-a3d5-8f236364f1de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:08.996549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aae9c-1905-4d3f-abcc-3f09710834d8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:09.029612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.033052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aff8e7-29da-4fa6-87eb-364b96ab6534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:09.033677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aff8e7-29da-4fa6-87eb-364b96ab6534 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:09.033950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aff8e7-29da-4fa6-87eb-364b96ab6534 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:09.034280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aff8e7-29da-4fa6-87eb-364b96ab6534 None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:09.035369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aff8e7-29da-4fa6-87eb-364b96ab6534 None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:09.036487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa4e07-0233-4de1-a3d5-8f236364f1de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:09.036914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aff8e7-29da-4fa6-87eb-364b96ab6534 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:09.038051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa4e07-0233-4de1-a3d5-8f236364f1de None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:09.045961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 218/444] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:08 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:09.045961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aff8e7-29da-4fa6-87eb-364b96ab6534 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:09.074033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.151374 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 227/445] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:09.151374 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa4e07-0233-4de1-a3d5-8f236364f1de None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:09.151659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aff8e7-29da-4fa6-87eb-364b96ab6534 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:09.183016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706606bc-d56e-4995-a4df-ef22f97eeac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:09.183609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706606bc-d56e-4995-a4df-ef22f97eeac9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:09.183921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706606bc-d56e-4995-a4df-ef22f97eeac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:09.184185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706606bc-d56e-4995-a4df-ef22f97eeac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:09.184905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706606bc-d56e-4995-a4df-ef22f97eeac9 None admin] RBAC: Adding query filter params (group.id=827fa2529be14c41bb1d35fa652d4556, role.id=8941b3ff5a124d0a918ea79de7649945, scope.project.id=5e21e073540045728f2ced13ce6d6eea) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:09.185210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706606bc-d56e-4995-a4df-ef22f97eeac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:09.186665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706606bc-d56e-4995-a4df-ef22f97eeac9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:09.192344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 219/446] 10.222.0.55 () {56 vars in 1376 bytes} [Fri Sep 2 09:13:09 2022] GET /identity/v3/role_assignments?group.id=827fa2529be14c41bb1d35fa652d4556&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=8941b3ff5a124d0a918ea79de7649945 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:09.193118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706606bc-d56e-4995-a4df-ef22f97eeac9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:09.251846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.259246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa4e07-0233-4de1-a3d5-8f236364f1de None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:09.297619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.305534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160de65-79ef-4b09-abbf-48906db9e39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:09.306171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160de65-79ef-4b09-abbf-48906db9e39a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:09.306396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706606bc-d56e-4995-a4df-ef22f97eeac9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:09.306514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160de65-79ef-4b09-abbf-48906db9e39a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:09.306858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160de65-79ef-4b09-abbf-48906db9e39a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:09.318522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160de65-79ef-4b09-abbf-48906db9e39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2160de65-79ef-4b09-abbf-48906db9e39a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:09.323576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:09.324669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:09.325588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 228/447] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:09.331296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160de65-79ef-4b09-abbf-48906db9e39a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:09.350474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39871987-f901-4494-adb3-ef6a946afb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:09.351102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39871987-f901-4494-adb3-ef6a946afb9d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:09.351375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39871987-f901-4494-adb3-ef6a946afb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:09.351645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39871987-f901-4494-adb3-ef6a946afb9d None admin] PATH_INFO: `/v3/projects/5e21e073540045728f2ced13ce6d6eea` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:09.352819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39871987-f901-4494-adb3-ef6a946afb9d None admin] RBAC: Authorizing `identity:get_project(project_id=5e21e073540045728f2ced13ce6d6eea)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:09.354894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39871987-f901-4494-adb3-ef6a946afb9d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:09.356752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 220/448] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:09 2022] GET /identity/v3/projects/5e21e073540045728f2ced13ce6d6eea => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:09.362218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39871987-f901-4494-adb3-ef6a946afb9d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:09.454172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160de65-79ef-4b09-abbf-48906db9e39a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:09.483466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39871987-f901-4494-adb3-ef6a946afb9d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:09.493117 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db73d1-8d18-41a7-b6c8-ef9270cf7b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:09.493725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db73d1-8d18-41a7-b6c8-ef9270cf7b32 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:09.494001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db73d1-8d18-41a7-b6c8-ef9270cf7b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:09.494294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db73d1-8d18-41a7-b6c8-ef9270cf7b32 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:09.494956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db73d1-8d18-41a7-b6c8-ef9270cf7b32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:09.495255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db73d1-8d18-41a7-b6c8-ef9270cf7b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:09.496670 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db73d1-8d18-41a7-b6c8-ef9270cf7b32 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:09.505277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 229/449] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:09.511965 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db73d1-8d18-41a7-b6c8-ef9270cf7b32 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:09.522792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744ae56-7663-4a97-b9b5-71deaa573d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:09.523424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744ae56-7663-4a97-b9b5-71deaa573d5b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:09.523700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744ae56-7663-4a97-b9b5-71deaa573d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:09.523995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744ae56-7663-4a97-b9b5-71deaa573d5b None admin] PATH_INFO: `/v3/groups/827fa2529be14c41bb1d35fa652d4556` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:09.525206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744ae56-7663-4a97-b9b5-71deaa573d5b None admin] RBAC: Authorizing `identity:get_group(group_id=827fa2529be14c41bb1d35fa652d4556)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:09.527204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744ae56-7663-4a97-b9b5-71deaa573d5b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:09.530954 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 221/450] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:09 2022] GET /identity/v3/groups/827fa2529be14c41bb1d35fa652d4556 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:09.533363 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.534758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744ae56-7663-4a97-b9b5-71deaa573d5b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:09.563931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.613286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db73d1-8d18-41a7-b6c8-ef9270cf7b32 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:09.632974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744ae56-7663-4a97-b9b5-71deaa573d5b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:09.646275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c516bd-7c2f-4919-af9c-6777962f192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:09.646890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c516bd-7c2f-4919-af9c-6777962f192f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:09.647144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c516bd-7c2f-4919-af9c-6777962f192f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:09.647413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c516bd-7c2f-4919-af9c-6777962f192f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:09.666490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76980e-0b41-4ea5-b99b-6d95d63310ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:09.667083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76980e-0b41-4ea5-b99b-6d95d63310ec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:09.667362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76980e-0b41-4ea5-b99b-6d95d63310ec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:09.667632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76980e-0b41-4ea5-b99b-6d95d63310ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:09.668404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76980e-0b41-4ea5-b99b-6d95d63310ec None admin] RBAC: Adding query filter params (group.id=827fa2529be14c41bb1d35fa652d4556, role.id=5691b81a7afd45eca087af3298e82784, scope.project.id=5e21e073540045728f2ced13ce6d6eea) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:09.668712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76980e-0b41-4ea5-b99b-6d95d63310ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:09.670146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76980e-0b41-4ea5-b99b-6d95d63310ec None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:09.675707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 222/451] 10.222.0.55 () {56 vars in 1376 bytes} [Fri Sep 2 09:13:09 2022] GET /identity/v3/role_assignments?group.id=827fa2529be14c41bb1d35fa652d4556&scope.project.id=5e21e073540045728f2ced13ce6d6eea&role.id=5691b81a7afd45eca087af3298e82784 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:09.716002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c516bd-7c2f-4919-af9c-6777962f192f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:09.717495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c516bd-7c2f-4919-af9c-6777962f192f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:09.736722 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.822402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 230/452] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:09.828744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76980e-0b41-4ea5-b99b-6d95d63310ec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:09.924720 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.933878 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76980e-0b41-4ea5-b99b-6d95d63310ec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:09.967562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9c6fc-7948-439a-98e2-046a0c23d38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:09.968224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9c6fc-7948-439a-98e2-046a0c23d38f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:09.968498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9c6fc-7948-439a-98e2-046a0c23d38f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:09.968768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9c6fc-7948-439a-98e2-046a0c23d38f None admin] PATH_INFO: `/v3/projects/736e52eb4dfe4b01a672224315f6274a` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:09.970949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9c6fc-7948-439a-98e2-046a0c23d38f None admin] RBAC: Authorizing `identity:get_project(project_id=736e52eb4dfe4b01a672224315f6274a)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:09.971320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9c6fc-7948-439a-98e2-046a0c23d38f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:09.973188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 223/453] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:13:09 2022] GET /identity/v3/projects/736e52eb4dfe4b01a672224315f6274a => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:09.978571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c516bd-7c2f-4919-af9c-6777962f192f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:10.077067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c516bd-7c2f-4919-af9c-6777962f192f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:10.093485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:10.109849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293934f1-01a0-4efa-b86b-a7a6b53921f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:10.110458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293934f1-01a0-4efa-b86b-a7a6b53921f5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:10.110730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293934f1-01a0-4efa-b86b-a7a6b53921f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:10.110997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293934f1-01a0-4efa-b86b-a7a6b53921f5 None admin] PATH_INFO: `/v3/groups/843094af2dce4d059b6250ba99602491` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:10.112096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293934f1-01a0-4efa-b86b-a7a6b53921f5 None admin] RBAC: Authorizing `identity:get_group(group_id=843094af2dce4d059b6250ba99602491)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:10.113532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293934f1-01a0-4efa-b86b-a7a6b53921f5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:10.115120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 231/454] 10.222.0.55 () {56 vars in 1180 bytes} [Fri Sep 2 09:13:09 2022] GET /identity/v3/groups/843094af2dce4d059b6250ba99602491 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:10.121999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9c6fc-7948-439a-98e2-046a0c23d38f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:10.218125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9c6fc-7948-439a-98e2-046a0c23d38f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:10.250794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a5d01-c34c-4ae8-bc2f-d9e14bb56073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:10.251377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a5d01-c34c-4ae8-bc2f-d9e14bb56073 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:10.251652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a5d01-c34c-4ae8-bc2f-d9e14bb56073 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:10.251949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a5d01-c34c-4ae8-bc2f-d9e14bb56073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:10.252662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a5d01-c34c-4ae8-bc2f-d9e14bb56073 None admin] RBAC: Adding query filter params (group.id=843094af2dce4d059b6250ba99602491, role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=736e52eb4dfe4b01a672224315f6274a) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:10.252968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a5d01-c34c-4ae8-bc2f-d9e14bb56073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:10.254398 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a5d01-c34c-4ae8-bc2f-d9e14bb56073 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:10.259902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 224/455] 10.222.0.55 () {56 vars in 1376 bytes} [Fri Sep 2 09:13:10 2022] GET /identity/v3/role_assignments?group.id=843094af2dce4d059b6250ba99602491&scope.project.id=736e52eb4dfe4b01a672224315f6274a&role.id=04d1bc62091440e189989e4b973a6627 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:12.540466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332a93-5f54-4862-a5e4-ed7adb993696 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:12.540990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332a93-5f54-4862-a5e4-ed7adb993696 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:12.540990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332a93-5f54-4862-a5e4-ed7adb993696 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:12.542894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 232/456] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:12.548239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcc724-eb84-4b5e-9d01-86e12ec77757 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:12.548689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcc724-eb84-4b5e-9d01-86e12ec77757 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:12.548974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcc724-eb84-4b5e-9d01-86e12ec77757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:12.569294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ebfcc724-eb84-4b5e-9d01-86e12ec77757 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:12.570788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ebfcc724-eb84-4b5e-9d01-86e12ec77757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:12.600293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:12.666516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 225/457] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:12.895914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee44c-9470-4dad-b5c8-dd0f9560ff6a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:12.896260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee44c-9470-4dad-b5c8-dd0f9560ff6a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:12.896461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee44c-9470-4dad-b5c8-dd0f9560ff6a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:12.898056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 233/458] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:12.903273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bbdab-2330-4fb1-9da0-a0cff7f9c29e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:12.903556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bbdab-2330-4fb1-9da0-a0cff7f9c29e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:12.903828 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bbdab-2330-4fb1-9da0-a0cff7f9c29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:12.928869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6c0bbdab-2330-4fb1-9da0-a0cff7f9c29e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:12.930067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6c0bbdab-2330-4fb1-9da0-a0cff7f9c29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:13.005157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099699a-9e70-4143-8737-60baa61accf7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:13.005476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099699a-9e70-4143-8737-60baa61accf7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:13.005704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099699a-9e70-4143-8737-60baa61accf7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:13.007161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 234/459] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:13:13.014884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291796ee-c589-482f-a076-49c824cd5335 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:13.015164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291796ee-c589-482f-a076-49c824cd5335 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:13.015430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291796ee-c589-482f-a076-49c824cd5335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:13.024887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 226/460] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:13.052973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-291796ee-c589-482f-a076-49c824cd5335 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:13.054177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-291796ee-c589-482f-a076-49c824cd5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:13.114520 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bbdab-2330-4fb1-9da0-a0cff7f9c29e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:13.138869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 235/461] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:13.211670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:13.227620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bbdab-2330-4fb1-9da0-a0cff7f9c29e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:13.264565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb233c-64f6-4acd-9445-a691eefcc571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:13.265500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb233c-64f6-4acd-9445-a691eefcc571 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:13.265914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb233c-64f6-4acd-9445-a691eefcc571 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:13.266333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb233c-64f6-4acd-9445-a691eefcc571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:13.280854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb233c-64f6-4acd-9445-a691eefcc571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:13.282509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb233c-64f6-4acd-9445-a691eefcc571 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-0ecb233c-64f6-4acd-9445-a691eefcc571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:13.303133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:13.304291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:13.305338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:13.305338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:13.305338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:13.306882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 227/462] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:13.313540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291796ee-c589-482f-a076-49c824cd5335 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:13.336355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb233c-64f6-4acd-9445-a691eefcc571 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:13.465044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb233c-64f6-4acd-9445-a691eefcc571 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:13.465224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291796ee-c589-482f-a076-49c824cd5335 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:13.490197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:13.498742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179dcb8-124d-4b57-8007-3bd4b176b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:13.499368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179dcb8-124d-4b57-8007-3bd4b176b51c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:13.499639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179dcb8-124d-4b57-8007-3bd4b176b51c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:13.499940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179dcb8-124d-4b57-8007-3bd4b176b51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:13.503059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:13.511814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179dcb8-124d-4b57-8007-3bd4b176b51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:13.513347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179dcb8-124d-4b57-8007-3bd4b176b51c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:13.515100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe659-5aec-430f-9a96-708772242f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:13.517798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe659-5aec-430f-9a96-708772242f86 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:13.518386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe659-5aec-430f-9a96-708772242f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:13.518808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe659-5aec-430f-9a96-708772242f86 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:13.519610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe659-5aec-430f-9a96-708772242f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:13.520095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe659-5aec-430f-9a96-708772242f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:13.522311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe659-5aec-430f-9a96-708772242f86 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8179dcb8-124d-4b57-8007-3bd4b176b51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:13.532051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:13.533171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:13.534049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:13.534049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:13.534049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:13.534049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 228/463] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:13.534946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd502088-4980-4b2c-a30e-a6f122dbc0bd None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:13.535229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd502088-4980-4b2c-a30e-a6f122dbc0bd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:13.535501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd502088-4980-4b2c-a30e-a6f122dbc0bd None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:13.537064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 229/464] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:13.541180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd502088-4980-4b2c-a30e-a6f122dbc0bd None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:13.545998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 236/465] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:13.547941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02775200-6799-4017-8278-d5d080b2f6fd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:13.548442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02775200-6799-4017-8278-d5d080b2f6fd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:13.548923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02775200-6799-4017-8278-d5d080b2f6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:13.569521 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-02775200-6799-4017-8278-d5d080b2f6fd None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:13.570391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-02775200-6799-4017-8278-d5d080b2f6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:13.642484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 237/466] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:13.643303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02775200-6799-4017-8278-d5d080b2f6fd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:13.677045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd502088-4980-4b2c-a30e-a6f122dbc0bd None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:13.723151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1235a5-34b9-456d-a200-7f3edf3ae5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:13.724516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1235a5-34b9-456d-a200-7f3edf3ae5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:13.725006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1235a5-34b9-456d-a200-7f3edf3ae5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:13.725875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1235a5-34b9-456d-a200-7f3edf3ae5d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:13.727014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1235a5-34b9-456d-a200-7f3edf3ae5d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:13.727514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1235a5-34b9-456d-a200-7f3edf3ae5d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:13.729841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1235a5-34b9-456d-a200-7f3edf3ae5d4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:13.748296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02775200-6799-4017-8278-d5d080b2f6fd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:13.754350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 230/467] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:13.755403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1235a5-34b9-456d-a200-7f3edf3ae5d4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:13.763023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:13.798270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc802cbf-4e98-495b-84b9-11d802cc41e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:13.798877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc802cbf-4e98-495b-84b9-11d802cc41e8 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:13.799153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc802cbf-4e98-495b-84b9-11d802cc41e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:13.799423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc802cbf-4e98-495b-84b9-11d802cc41e8 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:13.800124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc802cbf-4e98-495b-84b9-11d802cc41e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:13.801554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc802cbf-4e98-495b-84b9-11d802cc41e8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:13.827215 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:13.879407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1235a5-34b9-456d-a200-7f3edf3ae5d4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:13.894805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 238/468] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:13:13 2022] POST /identity/v3/users => generated 246 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:13:13.896305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc802cbf-4e98-495b-84b9-11d802cc41e8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:13.919620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bee15b-8a30-40e1-a9dc-3924760dd0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:13.920472 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bee15b-8a30-40e1-a9dc-3924760dd0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:13.920776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bee15b-8a30-40e1-a9dc-3924760dd0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:13.921539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bee15b-8a30-40e1-a9dc-3924760dd0b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:13.940940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bee15b-8a30-40e1-a9dc-3924760dd0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:13.942476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bee15b-8a30-40e1-a9dc-3924760dd0b0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e8bee15b-8a30-40e1-a9dc-3924760dd0b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:13.959132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:13.960156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:13.961459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:13.961459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:13.961459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:13.961459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 231/469] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:13.962313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bee15b-8a30-40e1-a9dc-3924760dd0b0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:14.039705 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc802cbf-4e98-495b-84b9-11d802cc41e8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:14.088594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70b75d-fb41-42af-a353-f72a38a5f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:14.089563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b75d-fb41-42af-a353-f72a38a5f234 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:14.090056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b75d-fb41-42af-a353-f72a38a5f234 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:14.090422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b75d-fb41-42af-a353-f72a38a5f234 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:14.091067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70b75d-fb41-42af-a353-f72a38a5f234 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:14.091523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:14.092601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70b75d-fb41-42af-a353-f72a38a5f234 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:14.094544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bee15b-8a30-40e1-a9dc-3924760dd0b0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:14.131366 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ecc58-4eee-4c32-9992-bcd36addcb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:14.132306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ecc58-4eee-4c32-9992-bcd36addcb05 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:14.132815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ecc58-4eee-4c32-9992-bcd36addcb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:14.133244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ecc58-4eee-4c32-9992-bcd36addcb05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:14.146024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ecc58-4eee-4c32-9992-bcd36addcb05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:14.147490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ecc58-4eee-4c32-9992-bcd36addcb05 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-2b7ecc58-4eee-4c32-9992-bcd36addcb05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:14.162955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:14.168038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:14.168880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:14.168880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:14.168880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:14.168880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 232/470] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:14.168880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ecc58-4eee-4c32-9992-bcd36addcb05 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:14.197526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 239/471] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:13:13 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:13:14.204025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70b75d-fb41-42af-a353-f72a38a5f234 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:14.252422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:14.366861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70b75d-fb41-42af-a353-f72a38a5f234 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:14.379246 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ecc58-4eee-4c32-9992-bcd36addcb05 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:14.412929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82755039-0094-4aba-9784-14fee2be91a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:14.413918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755039-0094-4aba-9784-14fee2be91a1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:14.414410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755039-0094-4aba-9784-14fee2be91a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:14.414894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755039-0094-4aba-9784-14fee2be91a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:14.415748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82755039-0094-4aba-9784-14fee2be91a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:14.416276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82755039-0094-4aba-9784-14fee2be91a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:14.418368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82755039-0094-4aba-9784-14fee2be91a1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:14.424753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360579e-65c8-4c6a-a214-bd796867b966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:14.425586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360579e-65c8-4c6a-a214-bd796867b966 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:14.426006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360579e-65c8-4c6a-a214-bd796867b966 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:14.426276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360579e-65c8-4c6a-a214-bd796867b966 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:14.427398 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360579e-65c8-4c6a-a214-bd796867b966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:14.427702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360579e-65c8-4c6a-a214-bd796867b966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:14.429574 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360579e-65c8-4c6a-a214-bd796867b966 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:14.434439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 240/472] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:14.435714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d353a-5979-4885-bf5c-85f4e42e56b2 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:14.436465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d353a-5979-4885-bf5c-85f4e42e56b2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:14.436754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d353a-5979-4885-bf5c-85f4e42e56b2 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:14.438241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 241/473] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:14.442164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 233/474] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:14.447513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d353a-5979-4885-bf5c-85f4e42e56b2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:14.447994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c354c24-0484-472a-a260-9f212d719a1b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:14.448276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c354c24-0484-472a-a260-9f212d719a1b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:14.448545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c354c24-0484-472a-a260-9f212d719a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:14.467580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6c354c24-0484-472a-a260-9f212d719a1b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:14.468808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6c354c24-0484-472a-a260-9f212d719a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:14.478148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:14.546534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:14.560655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 234/475] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:14.561895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c354c24-0484-472a-a260-9f212d719a1b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:14.580868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d353a-5979-4885-bf5c-85f4e42e56b2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:14.644767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4284a-f6f3-4b3a-a9d2-d7ce896601ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:14.645416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4284a-f6f3-4b3a-a9d2-d7ce896601ba None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:14.645697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4284a-f6f3-4b3a-a9d2-d7ce896601ba None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:14.645970 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4284a-f6f3-4b3a-a9d2-d7ce896601ba None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:14.646621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4284a-f6f3-4b3a-a9d2-d7ce896601ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:14.648081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4284a-f6f3-4b3a-a9d2-d7ce896601ba None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:14.685915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c354c24-0484-472a-a260-9f212d719a1b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:14.725968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e1ae8-6bc0-4304-aa63-11e41467ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:14.727005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e1ae8-6bc0-4304-aa63-11e41467ba10 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:14.727576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e1ae8-6bc0-4304-aa63-11e41467ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:14.728100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e1ae8-6bc0-4304-aa63-11e41467ba10 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:14.728973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e1ae8-6bc0-4304-aa63-11e41467ba10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:14.730588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e1ae8-6bc0-4304-aa63-11e41467ba10 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:14.767174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 242/476] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:13:14 2022] POST /identity/v3/users => generated 249 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:13:14.825662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:14.832605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 235/477] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:13:14 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:13:14.935357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4284a-f6f3-4b3a-a9d2-d7ce896601ba None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:15.058087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4284a-f6f3-4b3a-a9d2-d7ce896601ba None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:15.095221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698f684-b013-4971-9664-667fd8ded67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:15.096201 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698f684-b013-4971-9664-667fd8ded67f None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:15.096677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698f684-b013-4971-9664-667fd8ded67f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:15.097165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698f684-b013-4971-9664-667fd8ded67f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:15.098024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698f684-b013-4971-9664-667fd8ded67f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:15.099600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698f684-b013-4971-9664-667fd8ded67f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:15.103215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:15.142159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.sql.core [None req-3698f684-b013-4971-9664-667fd8ded67f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 09:13:15.142159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 02 09:13:15.142159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [parameters: {'id': 'da85381c3a564d4f8079bd547127bd56', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 02 09:13:15.142159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81573) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3698f684-b013-4971-9664-667fd8ded67f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Sep 02 09:13:15.159930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return ref.to_dict() Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 09:13:15.160820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application yield resource Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise self.value Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application session.commit() Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 09:13:15.161821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.flush() Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application compat.raise_( Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 09:13:15.162696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 09:13:15.163546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 09:13:15.164392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [parameters: {'id': 'da85381c3a564d4f8079bd547127bd56', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:15.165257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 02 09:13:15.166041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:15.169990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 243/478] 10.222.0.55 () {60 vars in 1131 bytes} [Fri Sep 2 09:13:14 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:15.175664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e1ae8-6bc0-4304-aa63-11e41467ba10 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:15.288090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e1ae8-6bc0-4304-aa63-11e41467ba10 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:15.331125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b680b70-d085-4d17-b1c3-c7b1f703f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:15.331766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b680b70-d085-4d17-b1c3-c7b1f703f55d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:15.332073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b680b70-d085-4d17-b1c3-c7b1f703f55d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:15.332386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b680b70-d085-4d17-b1c3-c7b1f703f55d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:15.345607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b680b70-d085-4d17-b1c3-c7b1f703f55d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6b680b70-d085-4d17-b1c3-c7b1f703f55d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:15.351209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:15.356789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:15.358484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 236/479] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:13:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:15.361040 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698f684-b013-4971-9664-667fd8ded67f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:15.500138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698f684-b013-4971-9664-667fd8ded67f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:15.536032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa9584-25ed-4305-afdf-d6b16f300b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:15.536635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa9584-25ed-4305-afdf-d6b16f300b26 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:15.536910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa9584-25ed-4305-afdf-d6b16f300b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:15.537181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa9584-25ed-4305-afdf-d6b16f300b26 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:15.537832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa9584-25ed-4305-afdf-d6b16f300b26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:15.538184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa9584-25ed-4305-afdf-d6b16f300b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:15.539544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa9584-25ed-4305-afdf-d6b16f300b26 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:15.548306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 244/480] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:16.041662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c3eb-b112-4c57-aa20-6fbc569b169f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:16.042173 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c3eb-b112-4c57-aa20-6fbc569b169f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:16.042459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c3eb-b112-4c57-aa20-6fbc569b169f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:16.044143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 237/481] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:16.049600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bd6b6-2077-4d87-858d-55fa44b7de76 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:16.049888 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bd6b6-2077-4d87-858d-55fa44b7de76 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:16.050160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bd6b6-2077-4d87-858d-55fa44b7de76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:16.073821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-cd3bd6b6-2077-4d87-858d-55fa44b7de76 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:16.074991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cd3bd6b6-2077-4d87-858d-55fa44b7de76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:16.154534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:16.170369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 245/482] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:16.494381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e32f0-67fe-41dd-b5b8-fc376c60d3ec None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:16.494646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e32f0-67fe-41dd-b5b8-fc376c60d3ec None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:16.494876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e32f0-67fe-41dd-b5b8-fc376c60d3ec None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:16.496475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 238/483] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:16.501681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147fb5a-ae4b-4c6f-8343-a915e7dad1a2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:16.501963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147fb5a-ae4b-4c6f-8343-a915e7dad1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:16.502230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147fb5a-ae4b-4c6f-8343-a915e7dad1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:16.527924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a147fb5a-ae4b-4c6f-8343-a915e7dad1a2 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:16.529102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a147fb5a-ae4b-4c6f-8343-a915e7dad1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:16.542664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e32f0-67fe-41dd-b5b8-fc376c60d3ec None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:16.603765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:16.634505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 246/484] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:16.661622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e32f0-67fe-41dd-b5b8-fc376c60d3ec None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:16.708137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5124-f538-433e-849b-7afa0f0482ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:16.708824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5124-f538-433e-849b-7afa0f0482ec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:16.709097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5124-f538-433e-849b-7afa0f0482ec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:16.709361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5124-f538-433e-849b-7afa0f0482ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:16.725868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f5124-f538-433e-849b-7afa0f0482ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d83f5124-f538-433e-849b-7afa0f0482ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:16.731305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:16.732224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:16.733007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 239/485] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:16.738289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147fb5a-ae4b-4c6f-8343-a915e7dad1a2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:16.881435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147fb5a-ae4b-4c6f-8343-a915e7dad1a2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:16.915323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:16.933576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71115cd-1c8e-4d56-b492-05d0641582af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:16.934181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71115cd-1c8e-4d56-b492-05d0641582af None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:16.935423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71115cd-1c8e-4d56-b492-05d0641582af None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:16.935423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71115cd-1c8e-4d56-b492-05d0641582af None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:16.935423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71115cd-1c8e-4d56-b492-05d0641582af None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:16.935651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71115cd-1c8e-4d56-b492-05d0641582af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:16.937088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71115cd-1c8e-4d56-b492-05d0641582af None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:16.950944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 247/486] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:16.956502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5124-f538-433e-849b-7afa0f0482ec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:16.965288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71115cd-1c8e-4d56-b492-05d0641582af None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:17.084002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71115cd-1c8e-4d56-b492-05d0641582af None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:17.095973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5124-f538-433e-849b-7afa0f0482ec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:17.115909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:17.137233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813028a5-1399-48f3-85b8-93dce5375ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:17.138153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813028a5-1399-48f3-85b8-93dce5375ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.138641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813028a5-1399-48f3-85b8-93dce5375ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.139093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813028a5-1399-48f3-85b8-93dce5375ac6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.141698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07c822-7a49-4612-b3cd-6cfaf95b8e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:17.142419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07c822-7a49-4612-b3cd-6cfaf95b8e07 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.142614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07c822-7a49-4612-b3cd-6cfaf95b8e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.142881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07c822-7a49-4612-b3cd-6cfaf95b8e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.151082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813028a5-1399-48f3-85b8-93dce5375ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-813028a5-1399-48f3-85b8-93dce5375ac6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:17.157110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:17.157990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:17.158769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:17.161416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 248/487] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:17.167069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07c822-7a49-4612-b3cd-6cfaf95b8e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:17.167955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813028a5-1399-48f3-85b8-93dce5375ac6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:17.168582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07c822-7a49-4612-b3cd-6cfaf95b8e07 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bd07c822-7a49-4612-b3cd-6cfaf95b8e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:17.185494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:17.186433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:17.187263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:17.187263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:17.187263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:17.187263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 240/488] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:17.196924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07c822-7a49-4612-b3cd-6cfaf95b8e07 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:17.217791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:17.301050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813028a5-1399-48f3-85b8-93dce5375ac6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:17.342448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b6401-b47f-4324-bd74-cd7f21908c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:17.343914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b6401-b47f-4324-bd74-cd7f21908c20 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.344460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b6401-b47f-4324-bd74-cd7f21908c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.344882 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b6401-b47f-4324-bd74-cd7f21908c20 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.345739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b6401-b47f-4324-bd74-cd7f21908c20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:17.346249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b6401-b47f-4324-bd74-cd7f21908c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:17.346413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07c822-7a49-4612-b3cd-6cfaf95b8e07 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:17.348037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b6401-b47f-4324-bd74-cd7f21908c20 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:17.360966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 249/489] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:17.365750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecf8de-9494-413e-a7c4-31dcf27514e7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.365750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecf8de-9494-413e-a7c4-31dcf27514e7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.365944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecf8de-9494-413e-a7c4-31dcf27514e7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.367421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 250/490] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:17.368180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecf8de-9494-413e-a7c4-31dcf27514e7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:17.393638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a8703-ab0a-4494-8816-50ce6b5dff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:17.395011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a8703-ab0a-4494-8816-50ce6b5dff11 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.395516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a8703-ab0a-4494-8816-50ce6b5dff11 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.396302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a8703-ab0a-4494-8816-50ce6b5dff11 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.397406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a8703-ab0a-4494-8816-50ce6b5dff11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:17.397908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a8703-ab0a-4494-8816-50ce6b5dff11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:17.400098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a8703-ab0a-4494-8816-50ce6b5dff11 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:17.414213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 241/491] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:17.415728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d7758-34ba-4d90-9207-d14513f27484 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.416235 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d7758-34ba-4d90-9207-d14513f27484 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.417269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d7758-34ba-4d90-9207-d14513f27484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.435515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6b0d7758-34ba-4d90-9207-d14513f27484 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:17.437077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6b0d7758-34ba-4d90-9207-d14513f27484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:17.486589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecf8de-9494-413e-a7c4-31dcf27514e7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:17.489023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:17.492226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:17.506070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 242/492] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:17.516189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d7758-34ba-4d90-9207-d14513f27484 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:17.530260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19362982-54a9-4b4c-acfa-7b3b06f2c21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:17.530983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19362982-54a9-4b4c-acfa-7b3b06f2c21d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.531267 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19362982-54a9-4b4c-acfa-7b3b06f2c21d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.531538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19362982-54a9-4b4c-acfa-7b3b06f2c21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.544225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19362982-54a9-4b4c-acfa-7b3b06f2c21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:17.548793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19362982-54a9-4b4c-acfa-7b3b06f2c21d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-19362982-54a9-4b4c-acfa-7b3b06f2c21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:17.562645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:17.563530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:17.564713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:17.564713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:17.564713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:17.564713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 251/493] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:17.567906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a6adc-491f-446a-ba7c-05777f47d875 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.567906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a6adc-491f-446a-ba7c-05777f47d875 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.567906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a6adc-491f-446a-ba7c-05777f47d875 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.567906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 252/494] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:17.569728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a6adc-491f-446a-ba7c-05777f47d875 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:17.633416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d7758-34ba-4d90-9207-d14513f27484 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:17.679815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f84f3-8bf9-4719-8e46-1fe8dcb9018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:17.681087 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f84f3-8bf9-4719-8e46-1fe8dcb9018d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.681535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f84f3-8bf9-4719-8e46-1fe8dcb9018d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.681948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f84f3-8bf9-4719-8e46-1fe8dcb9018d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.691352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f84f3-8bf9-4719-8e46-1fe8dcb9018d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:17.692785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f84f3-8bf9-4719-8e46-1fe8dcb9018d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:17.703624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a6adc-491f-446a-ba7c-05777f47d875 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b22f84f3-8bf9-4719-8e46-1fe8dcb9018d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:17.707195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:17.708267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:17.709360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:17.709360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:17.709360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:17.709360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:17.709360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:17.709360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:17.709360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:17.709360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:17.709360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:17.709360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:17.710711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 243/495] 10.222.0.55 () {56 vars in 1093 bytes} [Fri Sep 2 09:13:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:17.711829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a449-4718-4b72-991a-6b681c8d9395 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.712204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a449-4718-4b72-991a-6b681c8d9395 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.712549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a449-4718-4b72-991a-6b681c8d9395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.731412 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c260a449-4718-4b72-991a-6b681c8d9395 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:17.732739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c260a449-4718-4b72-991a-6b681c8d9395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:17.746830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e8b7-a863-47e8-824b-102254428ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:17.747769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e8b7-a863-47e8-824b-102254428ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.748294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e8b7-a863-47e8-824b-102254428ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.748708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:17.749906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e8b7-a863-47e8-824b-102254428ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.750781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097e8b7-a863-47e8-824b-102254428ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:17.751250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097e8b7-a863-47e8-824b-102254428ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:17.752982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097e8b7-a863-47e8-824b-102254428ca5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:17.766519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 253/496] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:17.767710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e8b7-a863-47e8-824b-102254428ca5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:17.791916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:17.812727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 244/497] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:17.812727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260a449-4718-4b72-991a-6b681c8d9395 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:17.890215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e8b7-a863-47e8-824b-102254428ca5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:17.930336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bf7b4-b197-4bb1-afc7-e4826994955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:17.931456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bf7b4-b197-4bb1-afc7-e4826994955a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.932266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bf7b4-b197-4bb1-afc7-e4826994955a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.932712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bf7b4-b197-4bb1-afc7-e4826994955a None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.934266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bf7b4-b197-4bb1-afc7-e4826994955a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:17.934780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bf7b4-b197-4bb1-afc7-e4826994955a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:17.937245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bf7b4-b197-4bb1-afc7-e4826994955a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:17.939472 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260a449-4718-4b72-991a-6b681c8d9395 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:17.976789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222e0b7-866b-4cf3-bf9a-04a3ea9ae258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:17.977669 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222e0b7-866b-4cf3-bf9a-04a3ea9ae258 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:17.978083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222e0b7-866b-4cf3-bf9a-04a3ea9ae258 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:17.978488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222e0b7-866b-4cf3-bf9a-04a3ea9ae258 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:17.985004 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 254/498] 10.222.0.55 () {56 vars in 1133 bytes} [Fri Sep 2 09:13:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:17.986014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bf7b4-b197-4bb1-afc7-e4826994955a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:17.987464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222e0b7-866b-4cf3-bf9a-04a3ea9ae258 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:17.989634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222e0b7-866b-4cf3-bf9a-04a3ea9ae258 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d222e0b7-866b-4cf3-bf9a-04a3ea9ae258 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:18.007623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:18.008561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:18.009424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:18.009424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:18.009424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:18.009424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:18.009424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:18.009424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:18.009424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:18.009424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:18.009424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 09:13:18.009424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:18.013235 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 245/499] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:18.014200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222e0b7-866b-4cf3-bf9a-04a3ea9ae258 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:18.030508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:18.073526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:18.102889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bf7b4-b197-4bb1-afc7-e4826994955a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:18.134751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222e0b7-866b-4cf3-bf9a-04a3ea9ae258 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:18.140434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46cbb9-e142-4b0f-9807-7e6c1c70f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:18.141010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46cbb9-e142-4b0f-9807-7e6c1c70f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.141315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46cbb9-e142-4b0f-9807-7e6c1c70f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.141675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46cbb9-e142-4b0f-9807-7e6c1c70f6f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.153130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46cbb9-e142-4b0f-9807-7e6c1c70f6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-fd46cbb9-e142-4b0f-9807-7e6c1c70f6f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:18.158396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:18.159468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 255/500] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:18.165029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46cbb9-e142-4b0f-9807-7e6c1c70f6f0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:18.170320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318323f-a220-46cb-be9d-b7e4baf295d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:18.170920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318323f-a220-46cb-be9d-b7e4baf295d4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.171194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318323f-a220-46cb-be9d-b7e4baf295d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.171460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318323f-a220-46cb-be9d-b7e4baf295d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.237884 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318323f-a220-46cb-be9d-b7e4baf295d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:18.239348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318323f-a220-46cb-be9d-b7e4baf295d4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:18.250185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:18.265708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46cbb9-e142-4b0f-9807-7e6c1c70f6f0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:18.299288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bc536-dfbe-4595-9676-b5e0a5161f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:18.299902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc536-dfbe-4595-9676-b5e0a5161f71 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.300191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc536-dfbe-4595-9676-b5e0a5161f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.300460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc536-dfbe-4595-9676-b5e0a5161f71 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.301168 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bc536-dfbe-4595-9676-b5e0a5161f71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:18.301465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bc536-dfbe-4595-9676-b5e0a5161f71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:18.302884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bc536-dfbe-4595-9676-b5e0a5161f71 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:18.304468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:18.319502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 256/501] 10.222.0.55 () {56 vars in 1137 bytes} [Fri Sep 2 09:13:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:18.320320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bc536-dfbe-4595-9676-b5e0a5161f71 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:18.341464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 246/502] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:18.342481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318323f-a220-46cb-be9d-b7e4baf295d4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:18.420091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bc536-dfbe-4595-9676-b5e0a5161f71 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:18.439177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318323f-a220-46cb-be9d-b7e4baf295d4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:18.449973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:18.452712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90354e3-7d84-447d-95cf-ab70d0628e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:18.453332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90354e3-7d84-447d-95cf-ab70d0628e94 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.453608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90354e3-7d84-447d-95cf-ab70d0628e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.453876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90354e3-7d84-447d-95cf-ab70d0628e94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.464158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90354e3-7d84-447d-95cf-ab70d0628e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c90354e3-7d84-447d-95cf-ab70d0628e94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:18.468956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:18.470024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:18.471003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 257/503] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:18.471754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c265-48f3-4f92-9bc1-c63ca55d8eb8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.471754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c265-48f3-4f92-9bc1-c63ca55d8eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.471754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c265-48f3-4f92-9bc1-c63ca55d8eb8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.473191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 258/504] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:18.473911 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c265-48f3-4f92-9bc1-c63ca55d8eb8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:18.477012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93055eac-3adc-49ff-a322-e91b75c61ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:18.477817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055eac-3adc-49ff-a322-e91b75c61ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.478192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055eac-3adc-49ff-a322-e91b75c61ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.478637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055eac-3adc-49ff-a322-e91b75c61ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.479407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93055eac-3adc-49ff-a322-e91b75c61ea3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:18.479712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93055eac-3adc-49ff-a322-e91b75c61ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:18.481116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93055eac-3adc-49ff-a322-e91b75c61ea3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:18.489729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 247/505] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:18.490280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93055eac-3adc-49ff-a322-e91b75c61ea3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:18.531961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:18.579138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c265-48f3-4f92-9bc1-c63ca55d8eb8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:18.590820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93055eac-3adc-49ff-a322-e91b75c61ea3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:18.613798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765acb0a-bef0-4216-ab1b-3840eb2cf226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:18.614399 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765acb0a-bef0-4216-ab1b-3840eb2cf226 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.614675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765acb0a-bef0-4216-ab1b-3840eb2cf226 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.614945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765acb0a-bef0-4216-ab1b-3840eb2cf226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.624851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc64612-bae3-4cf2-85d9-df8f4083b059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:18.625468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc64612-bae3-4cf2-85d9-df8f4083b059 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.626010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc64612-bae3-4cf2-85d9-df8f4083b059 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.626010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc64612-bae3-4cf2-85d9-df8f4083b059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.636626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc64612-bae3-4cf2-85d9-df8f4083b059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:18.638088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc64612-bae3-4cf2-85d9-df8f4083b059 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-4fc64612-bae3-4cf2-85d9-df8f4083b059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:18.653004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:18.654037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:18.654890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:18.654890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:18.654890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:18.654890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 248/506] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:18.655276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5fb3-1ee2-4481-8aa0-beb25a6e91b0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.655564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5fb3-1ee2-4481-8aa0-beb25a6e91b0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.655837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5fb3-1ee2-4481-8aa0-beb25a6e91b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.673183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ef0d5fb3-1ee2-4481-8aa0-beb25a6e91b0 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:18.674304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ef0d5fb3-1ee2-4481-8aa0-beb25a6e91b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:18.682821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765acb0a-bef0-4216-ab1b-3840eb2cf226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:18.684356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765acb0a-bef0-4216-ab1b-3840eb2cf226 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:18.691054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:18.734132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:18.741621 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 249/507] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:18.742450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5fb3-1ee2-4481-8aa0-beb25a6e91b0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:18.789251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 259/508] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:18.789251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765acb0a-bef0-4216-ab1b-3840eb2cf226 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:18.851338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5fb3-1ee2-4481-8aa0-beb25a6e91b0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:18.891994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d51bf-3ba1-48a9-b705-5ef626215294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:18.892600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d51bf-3ba1-48a9-b705-5ef626215294 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.892875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d51bf-3ba1-48a9-b705-5ef626215294 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.893350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d51bf-3ba1-48a9-b705-5ef626215294 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.893797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d51bf-3ba1-48a9-b705-5ef626215294 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:18.894101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d51bf-3ba1-48a9-b705-5ef626215294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:18.895467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d51bf-3ba1-48a9-b705-5ef626215294 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:18.899446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765acb0a-bef0-4216-ab1b-3840eb2cf226 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:18.908044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 250/509] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:18.908044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d51bf-3ba1-48a9-b705-5ef626215294 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:18.925405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:18.937785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebed7f-18ae-4ad4-bf22-9814c98759b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:18.938599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebed7f-18ae-4ad4-bf22-9814c98759b2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:18.938872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebed7f-18ae-4ad4-bf22-9814c98759b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:18.939143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebed7f-18ae-4ad4-bf22-9814c98759b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:18.950112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebed7f-18ae-4ad4-bf22-9814c98759b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:18.951550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebed7f-18ae-4ad4-bf22-9814c98759b2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c1ebed7f-18ae-4ad4-bf22-9814c98759b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:18.966276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:18.967170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:18.968066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:18.968066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:18.968066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:18.968066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 260/510] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:18.968891 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebed7f-18ae-4ad4-bf22-9814c98759b2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:18.973056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:19.022563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d51bf-3ba1-48a9-b705-5ef626215294 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.056127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80826db4-8cdc-4fc9-a452-0331b95acf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.056723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826db4-8cdc-4fc9-a452-0331b95acf6e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.057000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826db4-8cdc-4fc9-a452-0331b95acf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.057795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826db4-8cdc-4fc9-a452-0331b95acf6e None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.058421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80826db4-8cdc-4fc9-a452-0331b95acf6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:19.058716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80826db4-8cdc-4fc9-a452-0331b95acf6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.060096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80826db4-8cdc-4fc9-a452-0331b95acf6e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.071841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 251/511] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:19.071984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebed7f-18ae-4ad4-bf22-9814c98759b2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.072646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80826db4-8cdc-4fc9-a452-0331b95acf6e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.108915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3219060-0a5c-42c0-9288-2b3a1eaca039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.109530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3219060-0a5c-42c0-9288-2b3a1eaca039 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.109806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3219060-0a5c-42c0-9288-2b3a1eaca039 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.110077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3219060-0a5c-42c0-9288-2b3a1eaca039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.121595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3219060-0a5c-42c0-9288-2b3a1eaca039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.123056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3219060-0a5c-42c0-9288-2b3a1eaca039 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f3219060-0a5c-42c0-9288-2b3a1eaca039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:19.137557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:19.138528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:19.139357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:19.139357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:19.139357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:19.139357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 261/512] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:19.139357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3219060-0a5c-42c0-9288-2b3a1eaca039 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.151655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:19.175204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80826db4-8cdc-4fc9-a452-0331b95acf6e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.194612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:19.209403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecb0fd-6cd5-4f5b-a184-df75dd971f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.210077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb0fd-6cd5-4f5b-a184-df75dd971f94 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.210356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb0fd-6cd5-4f5b-a184-df75dd971f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.210626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb0fd-6cd5-4f5b-a184-df75dd971f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.220461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecb0fd-6cd5-4f5b-a184-df75dd971f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.221908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecb0fd-6cd5-4f5b-a184-df75dd971f94 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-08ecb0fd-6cd5-4f5b-a184-df75dd971f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:19.237115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:19.238162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:19.239096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:19.239096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:19.239096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:19.239513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3219060-0a5c-42c0-9288-2b3a1eaca039 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.239584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 252/513] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:19.239584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecb0fd-6cd5-4f5b-a184-df75dd971f94 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.273173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3b0eb-5863-4584-b533-ca55369483ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.273905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3b0eb-5863-4584-b533-ca55369483ff None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.274291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3b0eb-5863-4584-b533-ca55369483ff None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.274571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3b0eb-5863-4584-b533-ca55369483ff None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.275204 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3b0eb-5863-4584-b533-ca55369483ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:19.275506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3b0eb-5863-4584-b533-ca55369483ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.276922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3b0eb-5863-4584-b533-ca55369483ff None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.288450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 262/514] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:19.289241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3b0eb-5863-4584-b533-ca55369483ff None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.340895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecb0fd-6cd5-4f5b-a184-df75dd971f94 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.367230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:19.375855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250e067-652a-4929-ab2a-33acc37bbae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.376501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250e067-652a-4929-ab2a-33acc37bbae3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.376777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250e067-652a-4929-ab2a-33acc37bbae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.377050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250e067-652a-4929-ab2a-33acc37bbae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.388113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250e067-652a-4929-ab2a-33acc37bbae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.389580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250e067-652a-4929-ab2a-33acc37bbae3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.389729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3b0eb-5863-4584-b533-ca55369483ff None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e250e067-652a-4929-ab2a-33acc37bbae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:19.404201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:19.405283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:19.406158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:19.406158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:19.406158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:19.406158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 253/515] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:19.406531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250e067-652a-4929-ab2a-33acc37bbae3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.406811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:19.426587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3188ff-7605-42b5-a8c3-2bffc5eb555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.430960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3188ff-7605-42b5-a8c3-2bffc5eb555a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.430960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3188ff-7605-42b5-a8c3-2bffc5eb555a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.430960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3188ff-7605-42b5-a8c3-2bffc5eb555a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.434258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3188ff-7605-42b5-a8c3-2bffc5eb555a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.435678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3188ff-7605-42b5-a8c3-2bffc5eb555a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-bb3188ff-7605-42b5-a8c3-2bffc5eb555a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:19.448646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:19.449613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:19.450807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:19.450807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:19.450807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:19.450807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:19.450807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:19.450807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:19.450807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:19.450807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:19.450807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 263/516] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:19.450807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3188ff-7605-42b5-a8c3-2bffc5eb555a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.511418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250e067-652a-4929-ab2a-33acc37bbae3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.543511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c86ee-2ddc-49b8-a393-0b86f38f45b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.544138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c86ee-2ddc-49b8-a393-0b86f38f45b2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.544406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c86ee-2ddc-49b8-a393-0b86f38f45b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.544672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c86ee-2ddc-49b8-a393-0b86f38f45b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.545299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c86ee-2ddc-49b8-a393-0b86f38f45b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:19.545589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c86ee-2ddc-49b8-a393-0b86f38f45b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.546957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c86ee-2ddc-49b8-a393-0b86f38f45b2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.547735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3188ff-7605-42b5-a8c3-2bffc5eb555a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.558809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 254/517] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:19.559593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c86ee-2ddc-49b8-a393-0b86f38f45b2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.587336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a42e2-df2b-493b-88e2-041aa8ed5bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.587944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a42e2-df2b-493b-88e2-041aa8ed5bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.588222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a42e2-df2b-493b-88e2-041aa8ed5bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.588507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a42e2-df2b-493b-88e2-041aa8ed5bb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.589131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a42e2-df2b-493b-88e2-041aa8ed5bb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:19.589424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a42e2-df2b-493b-88e2-041aa8ed5bb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.590771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a42e2-df2b-493b-88e2-041aa8ed5bb5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.599382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:19.602711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 264/518] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:19.603307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a42e2-df2b-493b-88e2-041aa8ed5bb5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.639295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:19.657201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c86ee-2ddc-49b8-a393-0b86f38f45b2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.691077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e31d2a-59ec-4a48-89ba-fdd3686aafb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.691701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e31d2a-59ec-4a48-89ba-fdd3686aafb4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.692073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e31d2a-59ec-4a48-89ba-fdd3686aafb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.692348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e31d2a-59ec-4a48-89ba-fdd3686aafb4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.699773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e31d2a-59ec-4a48-89ba-fdd3686aafb4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.701186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e31d2a-59ec-4a48-89ba-fdd3686aafb4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.702015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a42e2-df2b-493b-88e2-041aa8ed5bb5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-69e31d2a-59ec-4a48-89ba-fdd3686aafb4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:19.712431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:19.713540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:19.714449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 255/519] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:19.714999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e31d2a-59ec-4a48-89ba-fdd3686aafb4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.739158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eedb7-6485-467c-922f-a0562701477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.739750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eedb7-6485-467c-922f-a0562701477a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.740062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eedb7-6485-467c-922f-a0562701477a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.740334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eedb7-6485-467c-922f-a0562701477a None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.740959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446eedb7-6485-467c-922f-a0562701477a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:19.741255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446eedb7-6485-467c-922f-a0562701477a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.742860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446eedb7-6485-467c-922f-a0562701477a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.754179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 265/520] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:19.754953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eedb7-6485-467c-922f-a0562701477a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.816543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:19.820362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e31d2a-59ec-4a48-89ba-fdd3686aafb4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.846867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:19.853178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eedb7-6485-467c-922f-a0562701477a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:19.854768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57cff-b0ee-4369-b44d-b0ff52674f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.855366 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57cff-b0ee-4369-b44d-b0ff52674f5b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.855634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57cff-b0ee-4369-b44d-b0ff52674f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.855931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57cff-b0ee-4369-b44d-b0ff52674f5b None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.856609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa57cff-b0ee-4369-b44d-b0ff52674f5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:19.856903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa57cff-b0ee-4369-b44d-b0ff52674f5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.858324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa57cff-b0ee-4369-b44d-b0ff52674f5b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.876156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 256/521] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:19.876958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57cff-b0ee-4369-b44d-b0ff52674f5b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.892934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf668f-51b6-4f96-8ef7-fb81644bffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:19.893579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf668f-51b6-4f96-8ef7-fb81644bffda None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:19.893857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf668f-51b6-4f96-8ef7-fb81644bffda None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:19.894142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf668f-51b6-4f96-8ef7-fb81644bffda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:19.900936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf668f-51b6-4f96-8ef7-fb81644bffda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:19.902542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf668f-51b6-4f96-8ef7-fb81644bffda None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-16bf668f-51b6-4f96-8ef7-fb81644bffda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:19.913872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:19.914703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:19.915572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:19.915572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:19.915572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:19.915572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:19.915572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:19.915572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:19.915572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:19.915572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:19.915572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 266/522] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:19.916058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf668f-51b6-4f96-8ef7-fb81644bffda None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:19.977233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57cff-b0ee-4369-b44d-b0ff52674f5b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:20.011616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827e532-6378-4e08-8cb1-5d25c5a9ab27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:20.012266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827e532-6378-4e08-8cb1-5d25c5a9ab27 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:20.012543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827e532-6378-4e08-8cb1-5d25c5a9ab27 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:20.012814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827e532-6378-4e08-8cb1-5d25c5a9ab27 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:20.014086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf668f-51b6-4f96-8ef7-fb81644bffda None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:20.020889 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827e532-6378-4e08-8cb1-5d25c5a9ab27 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:20.022336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827e532-6378-4e08-8cb1-5d25c5a9ab27 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8827e532-6378-4e08-8cb1-5d25c5a9ab27 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:20.033631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:20.034726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 257/523] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:20.035831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827e532-6378-4e08-8cb1-5d25c5a9ab27 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:20.050073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42649d-c8d4-4215-b178-4b1f2cd64609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:20.050746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42649d-c8d4-4215-b178-4b1f2cd64609 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:20.051090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42649d-c8d4-4215-b178-4b1f2cd64609 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:20.051368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42649d-c8d4-4215-b178-4b1f2cd64609 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:20.052120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42649d-c8d4-4215-b178-4b1f2cd64609 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:20.052423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42649d-c8d4-4215-b178-4b1f2cd64609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:20.053854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42649d-c8d4-4215-b178-4b1f2cd64609 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:20.058634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:20.075773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 267/524] 10.222.0.55 () {56 vars in 1137 bytes} [Fri Sep 2 09:13:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:20.075773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42649d-c8d4-4215-b178-4b1f2cd64609 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:20.088899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:20.133987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827e532-6378-4e08-8cb1-5d25c5a9ab27 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:20.166030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178ddd1-c95a-472d-9f14-134d7393bdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:20.167132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178ddd1-c95a-472d-9f14-134d7393bdc4 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:20.167399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178ddd1-c95a-472d-9f14-134d7393bdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:20.167666 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178ddd1-c95a-472d-9f14-134d7393bdc4 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:20.168322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178ddd1-c95a-472d-9f14-134d7393bdc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:20.169741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178ddd1-c95a-472d-9f14-134d7393bdc4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:20.171111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42649d-c8d4-4215-b178-4b1f2cd64609 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:20.204663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe695c-df06-4f8e-8f89-c53672ced253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:20.205261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe695c-df06-4f8e-8f89-c53672ced253 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:20.205540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe695c-df06-4f8e-8f89-c53672ced253 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:20.205813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe695c-df06-4f8e-8f89-c53672ced253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:20.206627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe695c-df06-4f8e-8f89-c53672ced253 None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=5d74d78932554527a8bcb5880b2b9c96) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:20.206885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe695c-df06-4f8e-8f89-c53672ced253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:20.208346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe695c-df06-4f8e-8f89-c53672ced253 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:20.214031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 268/525] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:20 2022] GET /identity/v3/role_assignments?user.id=5d74d78932554527a8bcb5880b2b9c96&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:20.214797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe695c-df06-4f8e-8f89-c53672ced253 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:20.254417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 258/526] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:13:20 2022] POST /identity/v3/users => generated 247 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:13:20.269127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178ddd1-c95a-472d-9f14-134d7393bdc4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:20.316418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:20.351331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe695c-df06-4f8e-8f89-c53672ced253 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:20.389055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:20.397838 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb468f-067d-47a3-a415-fc1220db2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:20.398843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb468f-067d-47a3-a415-fc1220db2c9a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:20.399421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb468f-067d-47a3-a415-fc1220db2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:20.399940 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb468f-067d-47a3-a415-fc1220db2c9a None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:20.400861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb468f-067d-47a3-a415-fc1220db2c9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:20.401890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb468f-067d-47a3-a415-fc1220db2c9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:20.403548 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb468f-067d-47a3-a415-fc1220db2c9a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:20.418003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178ddd1-c95a-472d-9f14-134d7393bdc4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:20.424989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 269/527] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:20.426026 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb468f-067d-47a3-a415-fc1220db2c9a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:20.461766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0086dee-5aaa-48ff-8a50-91cc2178c668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:20.462376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0086dee-5aaa-48ff-8a50-91cc2178c668 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:20.462646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0086dee-5aaa-48ff-8a50-91cc2178c668 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:20.462917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0086dee-5aaa-48ff-8a50-91cc2178c668 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:20.464240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0086dee-5aaa-48ff-8a50-91cc2178c668 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:20.464554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0086dee-5aaa-48ff-8a50-91cc2178c668 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:20.466379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0086dee-5aaa-48ff-8a50-91cc2178c668 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:20.509179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 259/528] 10.222.0.55 () {56 vars in 1139 bytes} [Fri Sep 2 09:13:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:20.509961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0086dee-5aaa-48ff-8a50-91cc2178c668 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:20.562618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb468f-067d-47a3-a415-fc1220db2c9a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:20.608428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd572f-4bdd-4352-8c7a-54074d7398fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:20.609276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd572f-4bdd-4352-8c7a-54074d7398fe None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:20.609553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd572f-4bdd-4352-8c7a-54074d7398fe None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:20.610231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd572f-4bdd-4352-8c7a-54074d7398fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:20.619400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0086dee-5aaa-48ff-8a50-91cc2178c668 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:20.638959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:20.656542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650feb5e-db76-4800-bdc1-ee9f8e5f63c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:20.660074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650feb5e-db76-4800-bdc1-ee9f8e5f63c3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:20.660074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650feb5e-db76-4800-bdc1-ee9f8e5f63c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:20.660074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650feb5e-db76-4800-bdc1-ee9f8e5f63c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:20.660074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650feb5e-db76-4800-bdc1-ee9f8e5f63c3 None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=2a6267b159204df7af8a4f84d227f88b) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:20.660074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650feb5e-db76-4800-bdc1-ee9f8e5f63c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:20.660528 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650feb5e-db76-4800-bdc1-ee9f8e5f63c3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:20.662429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:20.668298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 260/529] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:20 2022] GET /identity/v3/role_assignments?user.id=2a6267b159204df7af8a4f84d227f88b&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:20.669176 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650feb5e-db76-4800-bdc1-ee9f8e5f63c3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:20.700958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd572f-4bdd-4352-8c7a-54074d7398fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:20.703621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd572f-4bdd-4352-8c7a-54074d7398fe None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:20.804125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650feb5e-db76-4800-bdc1-ee9f8e5f63c3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:20.828768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 270/530] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:20.834498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd572f-4bdd-4352-8c7a-54074d7398fe None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:20.855211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acc7b2-6589-4e6b-aa36-8b96bef83438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:20.855924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc7b2-6589-4e6b-aa36-8b96bef83438 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:20.856184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc7b2-6589-4e6b-aa36-8b96bef83438 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:20.856452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc7b2-6589-4e6b-aa36-8b96bef83438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:20.911916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:20.974630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:20.983009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acc7b2-6589-4e6b-aa36-8b96bef83438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:20.984526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acc7b2-6589-4e6b-aa36-8b96bef83438 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:20.985330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd572f-4bdd-4352-8c7a-54074d7398fe None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:21.034385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8dd25-b336-4761-a579-9958aefcfeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:21.035383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8dd25-b336-4761-a579-9958aefcfeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:21.035849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8dd25-b336-4761-a579-9958aefcfeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:21.036373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8dd25-b336-4761-a579-9958aefcfeb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:21.059145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8dd25-b336-4761-a579-9958aefcfeb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:21.061066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8dd25-b336-4761-a579-9958aefcfeb1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-fdf8dd25-b336-4761-a579-9958aefcfeb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:21.088080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:21.089051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:21.089874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:21.089874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:21.089874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:21.091708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 271/531] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:21.097282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8dd25-b336-4761-a579-9958aefcfeb1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:21.099852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 261/532] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:21.105316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acc7b2-6589-4e6b-aa36-8b96bef83438 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:21.208693 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:21.219723 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8dd25-b336-4761-a579-9958aefcfeb1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:21.257536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56cf0-ab8d-4479-abe3-c9b2b509eb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:21.258405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56cf0-ab8d-4479-abe3-c9b2b509eb41 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:21.258879 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56cf0-ab8d-4479-abe3-c9b2b509eb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:21.259478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56cf0-ab8d-4479-abe3-c9b2b509eb41 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:21.260140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac56cf0-ab8d-4479-abe3-c9b2b509eb41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:21.261016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac56cf0-ab8d-4479-abe3-c9b2b509eb41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:21.262866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac56cf0-ab8d-4479-abe3-c9b2b509eb41 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:21.276748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 272/533] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:21.281699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56cf0-ab8d-4479-abe3-c9b2b509eb41 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:21.331002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:21.334623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acc7b2-6589-4e6b-aa36-8b96bef83438 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:21.378711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008655cc-98f2-4dff-959b-13a17fa370d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:21.379178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008655cc-98f2-4dff-959b-13a17fa370d2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:21.379461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008655cc-98f2-4dff-959b-13a17fa370d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:21.379729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008655cc-98f2-4dff-959b-13a17fa370d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:21.390499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008655cc-98f2-4dff-959b-13a17fa370d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:21.391995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008655cc-98f2-4dff-959b-13a17fa370d2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-008655cc-98f2-4dff-959b-13a17fa370d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:21.409321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:21.410242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:21.411276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:21.411276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:21.411276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:21.411276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 262/534] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:21.415809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008655cc-98f2-4dff-959b-13a17fa370d2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:21.434622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56cf0-ab8d-4479-abe3-c9b2b509eb41 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:21.519915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a496c-e0b0-4228-9658-fd43318b5196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:21.520566 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a496c-e0b0-4228-9658-fd43318b5196 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:21.520845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a496c-e0b0-4228-9658-fd43318b5196 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:21.521117 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a496c-e0b0-4228-9658-fd43318b5196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:21.533299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008655cc-98f2-4dff-959b-13a17fa370d2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:21.536903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a496c-e0b0-4228-9658-fd43318b5196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:21.538354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a496c-e0b0-4228-9658-fd43318b5196 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-515a496c-e0b0-4228-9658-fd43318b5196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:21.565356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:21.566238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:21.567046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:21.567046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:21.567046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:21.567046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:21.567046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:21.567046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:21.567046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:21.567046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:21.572514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 273/535] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:21.578925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a496c-e0b0-4228-9658-fd43318b5196 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:21.580288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222bc0-1fbe-4a94-a084-23dd31088222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:21.581185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222bc0-1fbe-4a94-a084-23dd31088222 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:21.581663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222bc0-1fbe-4a94-a084-23dd31088222 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:21.582123 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222bc0-1fbe-4a94-a084-23dd31088222 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:21.582948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f222bc0-1fbe-4a94-a084-23dd31088222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:21.583448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f222bc0-1fbe-4a94-a084-23dd31088222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:21.585047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f222bc0-1fbe-4a94-a084-23dd31088222 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:21.601906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:21.612641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 263/536] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:21.619110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222bc0-1fbe-4a94-a084-23dd31088222 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:21.640242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:21.728759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a496c-e0b0-4228-9658-fd43318b5196 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:21.776601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab03c9-9401-49dd-8d5e-2a777214ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:21.777217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab03c9-9401-49dd-8d5e-2a777214ff99 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:21.777493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab03c9-9401-49dd-8d5e-2a777214ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:21.777765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab03c9-9401-49dd-8d5e-2a777214ff99 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:21.778454 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab03c9-9401-49dd-8d5e-2a777214ff99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:21.778753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab03c9-9401-49dd-8d5e-2a777214ff99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:21.780398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab03c9-9401-49dd-8d5e-2a777214ff99 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:21.792871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222bc0-1fbe-4a94-a084-23dd31088222 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:21.801830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 274/537] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:21.808542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab03c9-9401-49dd-8d5e-2a777214ff99 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:21.860612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f0c75-6ef4-4830-8a00-fec78dac80af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:21.861262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0c75-6ef4-4830-8a00-fec78dac80af None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:21.861541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0c75-6ef4-4830-8a00-fec78dac80af None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:21.861815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0c75-6ef4-4830-8a00-fec78dac80af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:21.871543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f0c75-6ef4-4830-8a00-fec78dac80af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:21.873066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f0c75-6ef4-4830-8a00-fec78dac80af None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:21.881559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3d7f0c75-6ef4-4830-8a00-fec78dac80af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:21.904935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:21.908810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:21.909653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:21.909653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:21.909653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:21.909653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:21.909653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:21.909653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:21.909653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:21.909653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:21.909653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 264/538] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:21.916948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f0c75-6ef4-4830-8a00-fec78dac80af None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:21.918063 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab03c9-9401-49dd-8d5e-2a777214ff99 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:21.970740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7817e-df66-4ace-8266-895debbbefc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:21.971343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7817e-df66-4ace-8266-895debbbefc4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:21.971614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7817e-df66-4ace-8266-895debbbefc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:21.972588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7817e-df66-4ace-8266-895debbbefc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:21.973532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7817e-df66-4ace-8266-895debbbefc4 None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=81b6abdeca334777b597215dfe157688) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:21.973839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7817e-df66-4ace-8266-895debbbefc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:21.976444 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7817e-df66-4ace-8266-895debbbefc4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:21.990574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 275/539] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:21 2022] GET /identity/v3/role_assignments?user.id=81b6abdeca334777b597215dfe157688&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:22.040358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:22.089692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f0c75-6ef4-4830-8a00-fec78dac80af None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:22.136989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdfa5b-b164-442a-a5f5-860ceca62c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:22.137546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdfa5b-b164-442a-a5f5-860ceca62c16 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:22.137818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdfa5b-b164-442a-a5f5-860ceca62c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:22.138083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdfa5b-b164-442a-a5f5-860ceca62c16 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:22.138776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdfa5b-b164-442a-a5f5-860ceca62c16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:22.139073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdfa5b-b164-442a-a5f5-860ceca62c16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:22.140556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdfa5b-b164-442a-a5f5-860ceca62c16 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:22.155784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 265/540] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:22.161458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7817e-df66-4ace-8266-895debbbefc4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:22.312914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7817e-df66-4ace-8266-895debbbefc4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:22.363697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad29a03-e4cd-4b1f-98cd-a20e57f3fe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:22.364336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad29a03-e4cd-4b1f-98cd-a20e57f3fe39 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:22.364613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad29a03-e4cd-4b1f-98cd-a20e57f3fe39 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:22.364884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad29a03-e4cd-4b1f-98cd-a20e57f3fe39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:22.365601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad29a03-e4cd-4b1f-98cd-a20e57f3fe39 None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=81bb83de9f794ac9b02e5dca2df3e4d1) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:22.365907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad29a03-e4cd-4b1f-98cd-a20e57f3fe39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:22.367584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad29a03-e4cd-4b1f-98cd-a20e57f3fe39 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:22.369374 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:22.376341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 276/541] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:22 2022] GET /identity/v3/role_assignments?user.id=81bb83de9f794ac9b02e5dca2df3e4d1&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:22.570341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdce77-bfbd-42a2-8dd8-ad8645806cfe None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:22.570861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdce77-bfbd-42a2-8dd8-ad8645806cfe None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:22.570861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdce77-bfbd-42a2-8dd8-ad8645806cfe None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:22.572501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 266/542] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:22.578207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77999a-85c5-4e0d-a69e-4d11efec226c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:22.578504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77999a-85c5-4e0d-a69e-4d11efec226c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:22.578752 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77999a-85c5-4e0d-a69e-4d11efec226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:22.601942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ab77999a-85c5-4e0d-a69e-4d11efec226c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:22.603119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ab77999a-85c5-4e0d-a69e-4d11efec226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:22.640095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd9a7c-86da-404f-a306-cb1131f16bfb None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:22.640441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd9a7c-86da-404f-a306-cb1131f16bfb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:22.640646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd9a7c-86da-404f-a306-cb1131f16bfb None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:22.642187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 267/543] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:22.647290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c12683-44df-4619-b4fc-980974e3ef53 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:22.647560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c12683-44df-4619-b4fc-980974e3ef53 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:22.647854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c12683-44df-4619-b4fc-980974e3ef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:22.687104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a6c12683-44df-4619-b4fc-980974e3ef53 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:22.687818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 277/544] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:22.688355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a6c12683-44df-4619-b4fc-980974e3ef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:22.761322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 268/545] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:13:22.982490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77999a-85c5-4e0d-a69e-4d11efec226c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:23.088441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa9202-5b25-4e9e-9257-5da8f6846e94 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:23.089329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa9202-5b25-4e9e-9257-5da8f6846e94 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:23.089545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa9202-5b25-4e9e-9257-5da8f6846e94 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:23.090920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 269/546] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:23.095806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b2f68-f0c5-453c-bfb6-2f7d5ba6a843 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:23.096119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b2f68-f0c5-453c-bfb6-2f7d5ba6a843 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:23.096394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b2f68-f0c5-453c-bfb6-2f7d5ba6a843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:23.103317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77999a-85c5-4e0d-a69e-4d11efec226c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:23.119456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e82b2f68-f0c5-453c-bfb6-2f7d5ba6a843 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:23.120714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e82b2f68-f0c5-453c-bfb6-2f7d5ba6a843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:23.133662 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:23.141957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e43d4-c3d8-4544-93e5-0ed903cc3795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:23.142874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e43d4-c3d8-4544-93e5-0ed903cc3795 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:23.143157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e43d4-c3d8-4544-93e5-0ed903cc3795 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:23.143428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e43d4-c3d8-4544-93e5-0ed903cc3795 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:23.157959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e43d4-c3d8-4544-93e5-0ed903cc3795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-265e43d4-c3d8-4544-93e5-0ed903cc3795 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:23.164198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:23.165253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:23.166311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 278/547] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:23.167316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e43d4-c3d8-4544-93e5-0ed903cc3795 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:23.192276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:23.200080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 270/548] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:13:23.201026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b2f68-f0c5-453c-bfb6-2f7d5ba6a843 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:23.280856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e43d4-c3d8-4544-93e5-0ed903cc3795 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:23.316516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439af32-0d58-4ad9-a3fa-e0921ce00159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:23.317140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439af32-0d58-4ad9-a3fa-e0921ce00159 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:23.317417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439af32-0d58-4ad9-a3fa-e0921ce00159 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:23.317689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439af32-0d58-4ad9-a3fa-e0921ce00159 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:23.328901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439af32-0d58-4ad9-a3fa-e0921ce00159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3439af32-0d58-4ad9-a3fa-e0921ce00159 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:23.334016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:23.334933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:23.336303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 279/549] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:23.341203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439af32-0d58-4ad9-a3fa-e0921ce00159 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:23.381225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b2f68-f0c5-453c-bfb6-2f7d5ba6a843 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:23.433969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bcbd1-5a20-44d2-a4be-b7a7ddea881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:23.434583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bcbd1-5a20-44d2-a4be-b7a7ddea881b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:23.434862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bcbd1-5a20-44d2-a4be-b7a7ddea881b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:23.435137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bcbd1-5a20-44d2-a4be-b7a7ddea881b None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:23.435799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bcbd1-5a20-44d2-a4be-b7a7ddea881b None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:23.438286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bcbd1-5a20-44d2-a4be-b7a7ddea881b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:23.441349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bcbd1-5a20-44d2-a4be-b7a7ddea881b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:23.451119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:23.459667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 271/550] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:23.463491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bcbd1-5a20-44d2-a4be-b7a7ddea881b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:23.539064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439af32-0d58-4ad9-a3fa-e0921ce00159 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:23.554941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:23.608842 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf9e3a-e9d1-494d-9879-fd95204e0b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:23.609355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf9e3a-e9d1-494d-9879-fd95204e0b01 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:23.609625 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf9e3a-e9d1-494d-9879-fd95204e0b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:23.609886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf9e3a-e9d1-494d-9879-fd95204e0b01 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:23.610650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf9e3a-e9d1-494d-9879-fd95204e0b01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:23.610952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf9e3a-e9d1-494d-9879-fd95204e0b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:23.612350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf9e3a-e9d1-494d-9879-fd95204e0b01 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:23.621967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 280/551] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:23.622860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf9e3a-e9d1-494d-9879-fd95204e0b01 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:23.632722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bcbd1-5a20-44d2-a4be-b7a7ddea881b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:23.681783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdd3f5-e55c-490c-a862-cf5d09a6e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:23.683505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdd3f5-e55c-490c-a862-cf5d09a6e2ef None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:23.684265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdd3f5-e55c-490c-a862-cf5d09a6e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:23.685023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdd3f5-e55c-490c-a862-cf5d09a6e2ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:23.699019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdd3f5-e55c-490c-a862-cf5d09a6e2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:23.701165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdd3f5-e55c-490c-a862-cf5d09a6e2ef None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d6cdd3f5-e55c-490c-a862-cf5d09a6e2ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:23.720956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:23.721911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:23.722834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:23.722834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:23.722834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:23.725145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 272/552] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:23.726187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdd3f5-e55c-490c-a862-cf5d09a6e2ef None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:23.727254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf9e3a-e9d1-494d-9879-fd95204e0b01 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:23.739124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:23.764781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c098dd7-4145-4df5-b8e6-4a5a43e21e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:23.765792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c098dd7-4145-4df5-b8e6-4a5a43e21e39 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:23.766356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c098dd7-4145-4df5-b8e6-4a5a43e21e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:23.766969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c098dd7-4145-4df5-b8e6-4a5a43e21e39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:23.786709 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c098dd7-4145-4df5-b8e6-4a5a43e21e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9c098dd7-4145-4df5-b8e6-4a5a43e21e39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:23.794336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:23.795219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:23.796059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:23.803186 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 281/553] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:23.804397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c098dd7-4145-4df5-b8e6-4a5a43e21e39 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:23.868803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdd3f5-e55c-490c-a862-cf5d09a6e2ef None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:23.872348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:23.912976 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efba73-9019-45eb-8e7f-6d1217d4f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:23.913621 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efba73-9019-45eb-8e7f-6d1217d4f10c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:23.913902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efba73-9019-45eb-8e7f-6d1217d4f10c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:23.914177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efba73-9019-45eb-8e7f-6d1217d4f10c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:23.926294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c098dd7-4145-4df5-b8e6-4a5a43e21e39 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:23.930073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efba73-9019-45eb-8e7f-6d1217d4f10c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:23.931548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efba73-9019-45eb-8e7f-6d1217d4f10c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-85efba73-9019-45eb-8e7f-6d1217d4f10c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:23.950084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:23.951022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:23.951905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:23.951905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:23.951905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:23.951905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 273/554] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:23.952549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efba73-9019-45eb-8e7f-6d1217d4f10c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:23.966613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8d2b3-a02c-49c7-9e00-4a975832a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:23.967490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d2b3-a02c-49c7-9e00-4a975832a73f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:23.968134 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d2b3-a02c-49c7-9e00-4a975832a73f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:23.968630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d2b3-a02c-49c7-9e00-4a975832a73f None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:23.969456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8d2b3-a02c-49c7-9e00-4a975832a73f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:23.970005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8d2b3-a02c-49c7-9e00-4a975832a73f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:23.971813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8d2b3-a02c-49c7-9e00-4a975832a73f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:23.986069 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 282/555] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:23.987685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8d2b3-a02c-49c7-9e00-4a975832a73f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.018895 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:24.078397 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efba73-9019-45eb-8e7f-6d1217d4f10c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:24.111598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8d2b3-a02c-49c7-9e00-4a975832a73f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:24.117011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c9c10-db1e-4186-b7e9-ff62e86041ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:24.117846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c9c10-db1e-4186-b7e9-ff62e86041ba None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.118346 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c9c10-db1e-4186-b7e9-ff62e86041ba None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.118857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c9c10-db1e-4186-b7e9-ff62e86041ba None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.119703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c9c10-db1e-4186-b7e9-ff62e86041ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:24.120461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c9c10-db1e-4186-b7e9-ff62e86041ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:24.122032 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c9c10-db1e-4186-b7e9-ff62e86041ba None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:24.137882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 274/556] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:24.138797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c9c10-db1e-4186-b7e9-ff62e86041ba None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.151816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99242c12-7dac-4767-9ea2-0e9b62a89548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:24.152680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242c12-7dac-4767-9ea2-0e9b62a89548 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.153109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242c12-7dac-4767-9ea2-0e9b62a89548 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.153379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242c12-7dac-4767-9ea2-0e9b62a89548 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.154012 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99242c12-7dac-4767-9ea2-0e9b62a89548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:24.154311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99242c12-7dac-4767-9ea2-0e9b62a89548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:24.155682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99242c12-7dac-4767-9ea2-0e9b62a89548 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:24.159086 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:24.168079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 283/557] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:24.169532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637762af-4fb5-4a41-a0dc-9715dd03c49e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.169980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637762af-4fb5-4a41-a0dc-9715dd03c49e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.170474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637762af-4fb5-4a41-a0dc-9715dd03c49e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.172066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 284/558] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:24.172883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637762af-4fb5-4a41-a0dc-9715dd03c49e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.256417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c9c10-db1e-4186-b7e9-ff62e86041ba None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:24.267073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:24.278139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637762af-4fb5-4a41-a0dc-9715dd03c49e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:24.294743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2260d-04bd-4c38-af7e-2b9e5d4392e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:24.295417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2260d-04bd-4c38-af7e-2b9e5d4392e0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.295703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2260d-04bd-4c38-af7e-2b9e5d4392e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.296007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2260d-04bd-4c38-af7e-2b9e5d4392e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.304006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2260d-04bd-4c38-af7e-2b9e5d4392e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:24.305472 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2260d-04bd-4c38-af7e-2b9e5d4392e0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:24.314819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad94678-13b6-4614-83d8-e282eab8bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:24.315425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad94678-13b6-4614-83d8-e282eab8bede None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.315696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad94678-13b6-4614-83d8-e282eab8bede None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.315995 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad94678-13b6-4614-83d8-e282eab8bede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-88c2260d-04bd-4c38-af7e-2b9e5d4392e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:24.317596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:24.318531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 275/559] 10.222.0.55 () {56 vars in 1093 bytes} [Fri Sep 2 09:13:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:24.319454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2260d-04bd-4c38-af7e-2b9e5d4392e0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.332137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad94678-13b6-4614-83d8-e282eab8bede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:24.333716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad94678-13b6-4614-83d8-e282eab8bede None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2ad94678-13b6-4614-83d8-e282eab8bede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:24.350060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:24.351150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:24.352574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:24.352574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:24.352574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:24.352574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 285/560] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:24.352574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c922-6c49-41b6-b2c0-ea4e4cd30d00 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.352870 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c922-6c49-41b6-b2c0-ea4e4cd30d00 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.352870 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c922-6c49-41b6-b2c0-ea4e4cd30d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.374674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e9c3c922-6c49-41b6-b2c0-ea4e4cd30d00 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:24.375796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e9c3c922-6c49-41b6-b2c0-ea4e4cd30d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:24.412962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:24.433877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2260d-04bd-4c38-af7e-2b9e5d4392e0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:24.450214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 286/561] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:24.451346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c922-6c49-41b6-b2c0-ea4e4cd30d00 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.471404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2dcf7-f7f4-4bf0-9879-db17d0193fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:24.472456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2dcf7-f7f4-4bf0-9879-db17d0193fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.473034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2dcf7-f7f4-4bf0-9879-db17d0193fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.473508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2dcf7-f7f4-4bf0-9879-db17d0193fe3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.482006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2dcf7-f7f4-4bf0-9879-db17d0193fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:24.484026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2dcf7-f7f4-4bf0-9879-db17d0193fe3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bae2dcf7-f7f4-4bf0-9879-db17d0193fe3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:24.496846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:24.497786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:24.498783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:24.498783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:24.498783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:24.498783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:24.498783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:24.498783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:24.498783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:24.498783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:24.498783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:24.498783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:24.501409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 276/562] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:24.502462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2dcf7-f7f4-4bf0-9879-db17d0193fe3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.538569 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:24.576808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c922-6c49-41b6-b2c0-ea4e4cd30d00 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:24.614733 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e8276-fb73-439b-a69c-9cb55c65b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:24.615704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e8276-fb73-439b-a69c-9cb55c65b234 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.616215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e8276-fb73-439b-a69c-9cb55c65b234 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.616708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e8276-fb73-439b-a69c-9cb55c65b234 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.617878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e8276-fb73-439b-a69c-9cb55c65b234 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:24.617985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2dcf7-f7f4-4bf0-9879-db17d0193fe3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:24.618492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e8276-fb73-439b-a69c-9cb55c65b234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:24.620197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e8276-fb73-439b-a69c-9cb55c65b234 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:24.638981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 287/563] 10.222.0.55 () {56 vars in 1133 bytes} [Fri Sep 2 09:13:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:24.640274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e8276-fb73-439b-a69c-9cb55c65b234 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.664911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901b8fe-a149-4423-aaad-714a9e1a1025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:24.665580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901b8fe-a149-4423-aaad-714a9e1a1025 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.665842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901b8fe-a149-4423-aaad-714a9e1a1025 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.666115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901b8fe-a149-4423-aaad-714a9e1a1025 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.666753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901b8fe-a149-4423-aaad-714a9e1a1025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:24.667141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901b8fe-a149-4423-aaad-714a9e1a1025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:24.669374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901b8fe-a149-4423-aaad-714a9e1a1025 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:24.688253 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:24.688658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 277/564] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:24.690735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901b8fe-a149-4423-aaad-714a9e1a1025 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.753194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e8276-fb73-439b-a69c-9cb55c65b234 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:24.781347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:24.787438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e037dc-6f90-4bc6-ad9d-ba679852241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:24.788095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e037dc-6f90-4bc6-ad9d-ba679852241f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.788359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e037dc-6f90-4bc6-ad9d-ba679852241f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.788624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e037dc-6f90-4bc6-ad9d-ba679852241f None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.789394 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e037dc-6f90-4bc6-ad9d-ba679852241f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:24.789695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e037dc-6f90-4bc6-ad9d-ba679852241f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:24.791111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e037dc-6f90-4bc6-ad9d-ba679852241f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:24.798272 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901b8fe-a149-4423-aaad-714a9e1a1025 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:24.808318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 288/565] 10.222.0.55 () {56 vars in 1135 bytes} [Fri Sep 2 09:13:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:24.809118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e037dc-6f90-4bc6-ad9d-ba679852241f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.842619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5492179-68ed-40b9-bbba-7ae4c30404bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:24.843252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5492179-68ed-40b9-bbba-7ae4c30404bd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.843523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5492179-68ed-40b9-bbba-7ae4c30404bd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.843787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5492179-68ed-40b9-bbba-7ae4c30404bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.854178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5492179-68ed-40b9-bbba-7ae4c30404bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:24.855648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5492179-68ed-40b9-bbba-7ae4c30404bd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d5492179-68ed-40b9-bbba-7ae4c30404bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:24.871136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:24.872282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:24.873365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:24.873365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:24.873365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:24.876936 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 278/566] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:24.878051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669763de-dabf-41b9-a36f-e60aaf272eae None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.878334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669763de-dabf-41b9-a36f-e60aaf272eae None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.878606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669763de-dabf-41b9-a36f-e60aaf272eae None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.880015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 279/567] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:24.880534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669763de-dabf-41b9-a36f-e60aaf272eae None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.908939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e037dc-6f90-4bc6-ad9d-ba679852241f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:24.933017 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:24.942505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01a4f6-1e40-432d-87a5-5661e9f9f5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:24.943120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01a4f6-1e40-432d-87a5-5661e9f9f5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:24.943390 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01a4f6-1e40-432d-87a5-5661e9f9f5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:24.943673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01a4f6-1e40-432d-87a5-5661e9f9f5a8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:24.950585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01a4f6-1e40-432d-87a5-5661e9f9f5a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:24.952034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01a4f6-1e40-432d-87a5-5661e9f9f5a8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-bb01a4f6-1e40-432d-87a5-5661e9f9f5a8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:24.966323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:24.967417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 289/568] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:24.968683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01a4f6-1e40-432d-87a5-5661e9f9f5a8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:24.988943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669763de-dabf-41b9-a36f-e60aaf272eae None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.016952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:25.022386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370abb53-1d13-4602-83a7-065a6d6c950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.023007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370abb53-1d13-4602-83a7-065a6d6c950a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.023284 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370abb53-1d13-4602-83a7-065a6d6c950a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.023555 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370abb53-1d13-4602-83a7-065a6d6c950a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.034072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370abb53-1d13-4602-83a7-065a6d6c950a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-370abb53-1d13-4602-83a7-065a6d6c950a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:25.039374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:25.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 280/569] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:25.041307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370abb53-1d13-4602-83a7-065a6d6c950a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:25.069943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01a4f6-1e40-432d-87a5-5661e9f9f5a8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.102767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc712b-a658-4f6a-b968-c4c467961db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.103368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc712b-a658-4f6a-b968-c4c467961db6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.103648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc712b-a658-4f6a-b968-c4c467961db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.103951 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc712b-a658-4f6a-b968-c4c467961db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.139011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370abb53-1d13-4602-83a7-065a6d6c950a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.151338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:25.171443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc712b-a658-4f6a-b968-c4c467961db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:25.172857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc712b-a658-4f6a-b968-c4c467961db6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:25.175393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dc74b-9eca-4a2f-9bce-5b59f032e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.176035 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc74b-9eca-4a2f-9bce-5b59f032e7ca None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.176315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc74b-9eca-4a2f-9bce-5b59f032e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.176587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc74b-9eca-4a2f-9bce-5b59f032e7ca None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.177215 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dc74b-9eca-4a2f-9bce-5b59f032e7ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:25.177512 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dc74b-9eca-4a2f-9bce-5b59f032e7ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:25.178861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dc74b-9eca-4a2f-9bce-5b59f032e7ca None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:25.191660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 281/570] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:25.193109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78079f-d793-4567-af5f-dea0972d072b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.193392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78079f-d793-4567-af5f-dea0972d072b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.193668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78079f-d793-4567-af5f-dea0972d072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.211270 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ff78079f-d793-4567-af5f-dea0972d072b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:25.212506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ff78079f-d793-4567-af5f-dea0972d072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:25.221825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:25.271837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 290/571] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:25.272682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc712b-a658-4f6a-b968-c4c467961db6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:25.283354 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 282/572] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:25.284228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78079f-d793-4567-af5f-dea0972d072b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:25.384082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:25.388514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78079f-d793-4567-af5f-dea0972d072b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.390111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc712b-a658-4f6a-b968-c4c467961db6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.425387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a723a6-f6b0-4fd8-b984-6d05efa0986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.425912 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a723a6-f6b0-4fd8-b984-6d05efa0986c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.426185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a723a6-f6b0-4fd8-b984-6d05efa0986c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.426347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce12ee9-a5ab-4b34-a096-893cd6d1ed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.426455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a723a6-f6b0-4fd8-b984-6d05efa0986c None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.426955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce12ee9-a5ab-4b34-a096-893cd6d1ed56 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.427164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a723a6-f6b0-4fd8-b984-6d05efa0986c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:25.427257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce12ee9-a5ab-4b34-a096-893cd6d1ed56 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.427465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a723a6-f6b0-4fd8-b984-6d05efa0986c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:25.427572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce12ee9-a5ab-4b34-a096-893cd6d1ed56 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.428376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce12ee9-a5ab-4b34-a096-893cd6d1ed56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:25.428916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce12ee9-a5ab-4b34-a096-893cd6d1ed56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:25.429008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a723a6-f6b0-4fd8-b984-6d05efa0986c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:25.431003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce12ee9-a5ab-4b34-a096-893cd6d1ed56 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:25.441024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 283/573] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:25.441842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce12ee9-a5ab-4b34-a096-893cd6d1ed56 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:25.451448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 291/574] 10.222.0.55 () {56 vars in 1137 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:25.452310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a723a6-f6b0-4fd8-b984-6d05efa0986c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:25.461251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:25.552105 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce12ee9-a5ab-4b34-a096-893cd6d1ed56 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.553512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a723a6-f6b0-4fd8-b984-6d05efa0986c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.585496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed47190-8eda-41ef-999d-9e055ceeb042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.586118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed47190-8eda-41ef-999d-9e055ceeb042 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.586399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed47190-8eda-41ef-999d-9e055ceeb042 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.586672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed47190-8eda-41ef-999d-9e055ceeb042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.586884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe704f-ae6e-4dbc-8bd6-83fcf3c82f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.587500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe704f-ae6e-4dbc-8bd6-83fcf3c82f37 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.587775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe704f-ae6e-4dbc-8bd6-83fcf3c82f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.588073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe704f-ae6e-4dbc-8bd6-83fcf3c82f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.593194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed47190-8eda-41ef-999d-9e055ceeb042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:25.594637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed47190-8eda-41ef-999d-9e055ceeb042 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:25.597722 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe704f-ae6e-4dbc-8bd6-83fcf3c82f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:25.599133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe704f-ae6e-4dbc-8bd6-83fcf3c82f37 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-0ed47190-8eda-41ef-999d-9e055ceeb042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:25.606019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:25.606888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:25.607769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:25.607769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:25.607769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:25.607769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:25.607769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:25.607769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:25.607769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:25.607769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:25.607769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 284/575] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:25.608328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed47190-8eda-41ef-999d-9e055ceeb042 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2cbe704f-ae6e-4dbc-8bd6-83fcf3c82f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:25.615248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:25.616189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:25.617344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:25.617344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:25.617344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:25.617344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 292/576] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:25.617572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe704f-ae6e-4dbc-8bd6-83fcf3c82f37 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:25.637669 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:25.674330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:25.710663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed47190-8eda-41ef-999d-9e055ceeb042 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.715526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe704f-ae6e-4dbc-8bd6-83fcf3c82f37 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.745214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c486415-79a4-4a6b-9e2c-d86b70ce1f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.745831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486415-79a4-4a6b-9e2c-d86b70ce1f20 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.746108 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486415-79a4-4a6b-9e2c-d86b70ce1f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.746378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486415-79a4-4a6b-9e2c-d86b70ce1f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.748564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df5fe6-5b54-41bc-867e-c51df79c332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.749184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5fe6-5b54-41bc-867e-c51df79c332a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.749466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5fe6-5b54-41bc-867e-c51df79c332a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.749737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5fe6-5b54-41bc-867e-c51df79c332a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.756501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c486415-79a4-4a6b-9e2c-d86b70ce1f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:25.757971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c486415-79a4-4a6b-9e2c-d86b70ce1f20 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:25.760266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df5fe6-5b54-41bc-867e-c51df79c332a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:25.761707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df5fe6-5b54-41bc-867e-c51df79c332a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6c486415-79a4-4a6b-9e2c-d86b70ce1f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:25.771627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:25.772812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:25.774036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:25.774036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:25.774036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:25.774036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 285/577] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:25.774036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c486415-79a4-4a6b-9e2c-d86b70ce1f20 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-75df5fe6-5b54-41bc-867e-c51df79c332a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:25.778199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:25.779265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:25.780219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:25.780219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:25.780219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:25.780219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 293/578] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:25.780438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df5fe6-5b54-41bc-867e-c51df79c332a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:25.855046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:25.879154 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c486415-79a4-4a6b-9e2c-d86b70ce1f20 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.879297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df5fe6-5b54-41bc-867e-c51df79c332a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:25.889737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:25.912510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cfb03-08c8-4095-a6c3-31414df1a2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.912985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb6ff-fe63-49e1-8b00-388fdb59177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:25.913174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cfb03-08c8-4095-a6c3-31414df1a2bf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.913414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cfb03-08c8-4095-a6c3-31414df1a2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.913684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb6ff-fe63-49e1-8b00-388fdb59177c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:25.913781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cfb03-08c8-4095-a6c3-31414df1a2bf None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.913961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb6ff-fe63-49e1-8b00-388fdb59177c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:25.914229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb6ff-fe63-49e1-8b00-388fdb59177c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:25.914384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cfb03-08c8-4095-a6c3-31414df1a2bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:25.914694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cfb03-08c8-4095-a6c3-31414df1a2bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:25.916115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cfb03-08c8-4095-a6c3-31414df1a2bf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:25.924466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afb6ff-fe63-49e1-8b00-388fdb59177c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:25.928005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 294/579] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:25.928790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cfb03-08c8-4095-a6c3-31414df1a2bf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-09afb6ff-fe63-49e1-8b00-388fdb59177c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:25.929731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:25.930872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 286/580] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:25.932145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb6ff-fe63-49e1-8b00-388fdb59177c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.030004 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cfb03-08c8-4095-a6c3-31414df1a2bf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.035420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb6ff-fe63-49e1-8b00-388fdb59177c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.062513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46a80d-0a93-407c-a35f-62df37f63ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.063098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46a80d-0a93-407c-a35f-62df37f63ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.063374 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46a80d-0a93-407c-a35f-62df37f63ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.063640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46a80d-0a93-407c-a35f-62df37f63ae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.064294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46a80d-0a93-407c-a35f-62df37f63ae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:26.064590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46a80d-0a93-407c-a35f-62df37f63ae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.065990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46a80d-0a93-407c-a35f-62df37f63ae7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.067037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584278a-292d-45c6-a8c2-48d45d60a5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.067627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584278a-292d-45c6-a8c2-48d45d60a5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.067919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584278a-292d-45c6-a8c2-48d45d60a5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.068192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584278a-292d-45c6-a8c2-48d45d60a5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.068816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584278a-292d-45c6-a8c2-48d45d60a5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:26.069112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584278a-292d-45c6-a8c2-48d45d60a5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.070483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584278a-292d-45c6-a8c2-48d45d60a5d3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.071894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:26.077425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 295/581] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:26.078211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46a80d-0a93-407c-a35f-62df37f63ae7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.083932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 287/582] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:26.085001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584278a-292d-45c6-a8c2-48d45d60a5d3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.111322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:26.178946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46a80d-0a93-407c-a35f-62df37f63ae7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.184651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584278a-292d-45c6-a8c2-48d45d60a5d3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.212467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fe24-fd16-40dd-962c-aca9848472ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.213067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fe24-fd16-40dd-962c-aca9848472ed None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.213343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fe24-fd16-40dd-962c-aca9848472ed None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.213612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fe24-fd16-40dd-962c-aca9848472ed None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.214880 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8fe24-fd16-40dd-962c-aca9848472ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:26.215185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8fe24-fd16-40dd-962c-aca9848472ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.216572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8fe24-fd16-40dd-962c-aca9848472ed None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.218138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb3a2-25d3-408d-9529-4fa8a5971757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.218774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb3a2-25d3-408d-9529-4fa8a5971757 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.219046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb3a2-25d3-408d-9529-4fa8a5971757 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.219314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb3a2-25d3-408d-9529-4fa8a5971757 None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/5d74d78932554527a8bcb5880b2b9c96/roles/8f47585e7ab1400689facb80e605e850` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.227850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 296/583] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:26.228763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fe24-fd16-40dd-962c-aca9848472ed None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.233057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fb3a2-25d3-408d-9529-4fa8a5971757 None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=5d74d78932554527a8bcb5880b2b9c96, role_id=8f47585e7ab1400689facb80e605e850)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.234496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fb3a2-25d3-408d-9529-4fa8a5971757 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.314658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 288/584] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:13:26 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/5d74d78932554527a8bcb5880b2b9c96/roles/8f47585e7ab1400689facb80e605e850 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:13:26.315429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb3a2-25d3-408d-9529-4fa8a5971757 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.327762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:26.339252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fe24-fd16-40dd-962c-aca9848472ed None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.368522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:26.380571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f98f85-378a-4345-bd25-f998aba6cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.381191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98f85-378a-4345-bd25-f998aba6cb6c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.381464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98f85-378a-4345-bd25-f998aba6cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.381729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98f85-378a-4345-bd25-f998aba6cb6c None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.382460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f98f85-378a-4345-bd25-f998aba6cb6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:26.382817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f98f85-378a-4345-bd25-f998aba6cb6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.384431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f98f85-378a-4345-bd25-f998aba6cb6c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.399311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 297/585] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:26.399311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f98f85-378a-4345-bd25-f998aba6cb6c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.434829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb3a2-25d3-408d-9529-4fa8a5971757 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.475679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc235062-b84c-4e08-a3c2-914b40450571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.476395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc235062-b84c-4e08-a3c2-914b40450571 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.476672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc235062-b84c-4e08-a3c2-914b40450571 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.476948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc235062-b84c-4e08-a3c2-914b40450571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.483862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc235062-b84c-4e08-a3c2-914b40450571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.485460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc235062-b84c-4e08-a3c2-914b40450571 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-dc235062-b84c-4e08-a3c2-914b40450571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:26.497614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:26.498493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:26.499971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:26.499971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:26.499971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:26.499971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:26.499971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:26.499971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:26.499971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:26.499971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:26.499971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 289/586] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:26.499971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc235062-b84c-4e08-a3c2-914b40450571 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.513501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f98f85-378a-4345-bd25-f998aba6cb6c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.546704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab316623-18ac-4482-a9d4-61d21a677485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.547342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab316623-18ac-4482-a9d4-61d21a677485 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.547619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab316623-18ac-4482-a9d4-61d21a677485 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.547913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab316623-18ac-4482-a9d4-61d21a677485 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.555861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab316623-18ac-4482-a9d4-61d21a677485 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.557321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab316623-18ac-4482-a9d4-61d21a677485 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ab316623-18ac-4482-a9d4-61d21a677485 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:26.569461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:26.570538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 298/587] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:26.572097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab316623-18ac-4482-a9d4-61d21a677485 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.588897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:26.607315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc235062-b84c-4e08-a3c2-914b40450571 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.609665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:26.644073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019da38-176f-476f-b7f8-6ced19d41d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.644773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019da38-176f-476f-b7f8-6ced19d41d14 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.645047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019da38-176f-476f-b7f8-6ced19d41d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.645343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019da38-176f-476f-b7f8-6ced19d41d14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.652426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019da38-176f-476f-b7f8-6ced19d41d14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.654406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019da38-176f-476f-b7f8-6ced19d41d14 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7019da38-176f-476f-b7f8-6ced19d41d14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:26.665816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:26.666700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:26.668167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:26.668167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:26.668167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:26.668167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:26.668167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:26.668167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:26.668167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:26.668167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:26.668167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 290/588] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:26.668667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019da38-176f-476f-b7f8-6ced19d41d14 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.685227 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab316623-18ac-4482-a9d4-61d21a677485 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.721737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75781e-ed60-442e-9d2e-88805c02a77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.722472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75781e-ed60-442e-9d2e-88805c02a77b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.722816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75781e-ed60-442e-9d2e-88805c02a77b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.723160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75781e-ed60-442e-9d2e-88805c02a77b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.734354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75781e-ed60-442e-9d2e-88805c02a77b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.735975 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75781e-ed60-442e-9d2e-88805c02a77b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4c75781e-ed60-442e-9d2e-88805c02a77b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:26.752346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:26.753485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:26.755183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:26.755183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:26.755183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:26.755183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 299/589] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:26.756335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75781e-ed60-442e-9d2e-88805c02a77b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.774933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019da38-176f-476f-b7f8-6ced19d41d14 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.816053 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456d781-cc46-4dd7-a34b-c84c0f54af73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.816806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456d781-cc46-4dd7-a34b-c84c0f54af73 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.817083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456d781-cc46-4dd7-a34b-c84c0f54af73 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.817348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456d781-cc46-4dd7-a34b-c84c0f54af73 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.818034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456d781-cc46-4dd7-a34b-c84c0f54af73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:26.818357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456d781-cc46-4dd7-a34b-c84c0f54af73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.819932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456d781-cc46-4dd7-a34b-c84c0f54af73 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.829649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:26.838131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 291/590] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:26.838131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456d781-cc46-4dd7-a34b-c84c0f54af73 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.866608 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:26.877625 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75781e-ed60-442e-9d2e-88805c02a77b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.915207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923131e-cd1d-44e7-9214-84bde9d1a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.915928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923131e-cd1d-44e7-9214-84bde9d1a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.916279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923131e-cd1d-44e7-9214-84bde9d1a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.917545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923131e-cd1d-44e7-9214-84bde9d1a8e3 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.918346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923131e-cd1d-44e7-9214-84bde9d1a8e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:26.918723 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923131e-cd1d-44e7-9214-84bde9d1a8e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.920938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923131e-cd1d-44e7-9214-84bde9d1a8e3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:26.941741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 300/591] 10.222.0.55 () {56 vars in 1137 bytes} [Fri Sep 2 09:13:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:26.942580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923131e-cd1d-44e7-9214-84bde9d1a8e3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:26.943572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456d781-cc46-4dd7-a34b-c84c0f54af73 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:26.983404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf45d-bd7e-41cf-b830-620983efcf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:26.984039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf45d-bd7e-41cf-b830-620983efcf63 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:26.984312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf45d-bd7e-41cf-b830-620983efcf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:26.984581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf45d-bd7e-41cf-b830-620983efcf63 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:26.985373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf45d-bd7e-41cf-b830-620983efcf63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:26.985674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf45d-bd7e-41cf-b830-620983efcf63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:26.987119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf45d-bd7e-41cf-b830-620983efcf63 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:27.005281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 292/592] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:27.006166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf45d-bd7e-41cf-b830-620983efcf63 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:27.046157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923131e-cd1d-44e7-9214-84bde9d1a8e3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:27.069168 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:27.082991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ddf53-c5c8-44b4-933f-a8f6c86544fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:27.083529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ddf53-c5c8-44b4-933f-a8f6c86544fe None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:27.083803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ddf53-c5c8-44b4-933f-a8f6c86544fe None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:27.084102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ddf53-c5c8-44b4-933f-a8f6c86544fe None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:27.084731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ddf53-c5c8-44b4-933f-a8f6c86544fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:27.085029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ddf53-c5c8-44b4-933f-a8f6c86544fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:27.086789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ddf53-c5c8-44b4-933f-a8f6c86544fe None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:27.095726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:27.105579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 301/593] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:27.105579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ddf53-c5c8-44b4-933f-a8f6c86544fe None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:27.115393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf45d-bd7e-41cf-b830-620983efcf63 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:27.151126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1702ac-fe67-493a-8a8d-e0c789ba11ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:27.152278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1702ac-fe67-493a-8a8d-e0c789ba11ac None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:27.152553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1702ac-fe67-493a-8a8d-e0c789ba11ac None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:27.152823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1702ac-fe67-493a-8a8d-e0c789ba11ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:27.153540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1702ac-fe67-493a-8a8d-e0c789ba11ac None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=01367d6c12014bc0bc9410b4a5a98693) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:27.153841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1702ac-fe67-493a-8a8d-e0c789ba11ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:27.155280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1702ac-fe67-493a-8a8d-e0c789ba11ac None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:27.160606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 293/594] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:27 2022] GET /identity/v3/role_assignments?user.id=01367d6c12014bc0bc9410b4a5a98693&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:27.161358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1702ac-fe67-493a-8a8d-e0c789ba11ac None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:27.238484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ddf53-c5c8-44b4-933f-a8f6c86544fe None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:27.282468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1702ac-fe67-493a-8a8d-e0c789ba11ac None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:27.284044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e1d4-6666-4074-9047-d45d4ec18449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:27.285043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e1d4-6666-4074-9047-d45d4ec18449 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:27.285498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e1d4-6666-4074-9047-d45d4ec18449 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:27.285970 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e1d4-6666-4074-9047-d45d4ec18449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:27.301716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0e1d4-6666-4074-9047-d45d4ec18449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:27.303404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0e1d4-6666-4074-9047-d45d4ec18449 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-42d0e1d4-6666-4074-9047-d45d4ec18449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:27.320942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:27.322129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:27.323273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:27.323273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:27.323273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:27.323273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 302/595] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:27.323273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e1d4-6666-4074-9047-d45d4ec18449 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:27.340625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccd4b4-2800-4e4a-b12b-e2985faf8186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:27.341629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccd4b4-2800-4e4a-b12b-e2985faf8186 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:27.342023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccd4b4-2800-4e4a-b12b-e2985faf8186 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:27.342393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccd4b4-2800-4e4a-b12b-e2985faf8186 None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/2a6267b159204df7af8a4f84d227f88b/roles/8f47585e7ab1400689facb80e605e850` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:27.360343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:27.365341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccd4b4-2800-4e4a-b12b-e2985faf8186 None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=2a6267b159204df7af8a4f84d227f88b, role_id=8f47585e7ab1400689facb80e605e850)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:27.370192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccd4b4-2800-4e4a-b12b-e2985faf8186 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:27.428838 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e1d4-6666-4074-9047-d45d4ec18449 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:27.443731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:27.456577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 294/596] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:13:27 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/2a6267b159204df7af8a4f84d227f88b/roles/8f47585e7ab1400689facb80e605e850 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:13:27.458850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccd4b4-2800-4e4a-b12b-e2985faf8186 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:27.493427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a463a7-6238-4823-8dc4-8c8e317bf9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:27.494103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a463a7-6238-4823-8dc4-8c8e317bf9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:27.494355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a463a7-6238-4823-8dc4-8c8e317bf9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:27.494646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a463a7-6238-4823-8dc4-8c8e317bf9e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:27.514188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a463a7-6238-4823-8dc4-8c8e317bf9e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:27.515668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a463a7-6238-4823-8dc4-8c8e317bf9e6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a4a463a7-6238-4823-8dc4-8c8e317bf9e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:27.541638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:27.542730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:27.544076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 303/597] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:27.548469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a463a7-6238-4823-8dc4-8c8e317bf9e6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:27.660215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:27.674710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a463a7-6238-4823-8dc4-8c8e317bf9e6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:27.685867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccd4b4-2800-4e4a-b12b-e2985faf8186 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:27.725233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aaf0b-8b4e-4bde-8c81-45acd3d483f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:27.725988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aaf0b-8b4e-4bde-8c81-45acd3d483f4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:27.726274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aaf0b-8b4e-4bde-8c81-45acd3d483f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:27.726545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aaf0b-8b4e-4bde-8c81-45acd3d483f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:27.727192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aaf0b-8b4e-4bde-8c81-45acd3d483f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:27.727491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aaf0b-8b4e-4bde-8c81-45acd3d483f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:27.729626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aaf0b-8b4e-4bde-8c81-45acd3d483f4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:27.740354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77c189-d401-44ee-abeb-009189fa51eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:27.740969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c189-d401-44ee-abeb-009189fa51eb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:27.741238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c189-d401-44ee-abeb-009189fa51eb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:27.741508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c189-d401-44ee-abeb-009189fa51eb None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:27.742489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77c189-d401-44ee-abeb-009189fa51eb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:27.742855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77c189-d401-44ee-abeb-009189fa51eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:27.744330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77c189-d401-44ee-abeb-009189fa51eb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:27.748791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 295/598] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:27.754413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aaf0b-8b4e-4bde-8c81-45acd3d483f4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:27.764366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 304/599] 10.222.0.55 () {56 vars in 1139 bytes} [Fri Sep 2 09:13:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:27.773367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77c189-d401-44ee-abeb-009189fa51eb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:27.868265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:27.946317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aaf0b-8b4e-4bde-8c81-45acd3d483f4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:27.950310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77c189-d401-44ee-abeb-009189fa51eb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:28.014264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33511fe-c010-448b-ae0c-5dde1b97f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:28.015450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33511fe-c010-448b-ae0c-5dde1b97f101 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:28.015740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33511fe-c010-448b-ae0c-5dde1b97f101 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:28.016041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33511fe-c010-448b-ae0c-5dde1b97f101 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:28.017160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c835-05ad-4fb5-bc06-c7a474cfa1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:28.017797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c835-05ad-4fb5-bc06-c7a474cfa1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:28.018067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c835-05ad-4fb5-bc06-c7a474cfa1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:28.018334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c835-05ad-4fb5-bc06-c7a474cfa1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:28.031969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33511fe-c010-448b-ae0c-5dde1b97f101 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:28.033391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33511fe-c010-448b-ae0c-5dde1b97f101 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:28.037522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1c835-05ad-4fb5-bc06-c7a474cfa1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:28.039075 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1c835-05ad-4fb5-bc06-c7a474cfa1d1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-5fd1c835-05ad-4fb5-bc06-c7a474cfa1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:28.054279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:28.055626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:28.057088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:28.057088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:28.057088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:28.057088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 305/600] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b33511fe-c010-448b-ae0c-5dde1b97f101 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:28.057317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:28.058618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:28.060431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:28.060431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:28.060431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:28.060431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:28.060431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:28.060431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:28.060431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:28.060431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:28.060431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 296/601] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:28.067902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c835-05ad-4fb5-bc06-c7a474cfa1d1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:28.068102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:28.075503 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33511fe-c010-448b-ae0c-5dde1b97f101 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:28.172127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c835-05ad-4fb5-bc06-c7a474cfa1d1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:28.207820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5a33-4200-4899-a161-0f31be1813e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:28.208377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5a33-4200-4899-a161-0f31be1813e0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:28.208654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5a33-4200-4899-a161-0f31be1813e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:28.208924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5a33-4200-4899-a161-0f31be1813e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:28.209608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc5a33-4200-4899-a161-0f31be1813e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:28.209914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc5a33-4200-4899-a161-0f31be1813e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:28.211342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc5a33-4200-4899-a161-0f31be1813e0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:28.228284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 306/602] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:28.230567 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5a33-4200-4899-a161-0f31be1813e0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:28.296189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:28.319658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33511fe-c010-448b-ae0c-5dde1b97f101 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:28.334595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5a33-4200-4899-a161-0f31be1813e0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:28.346254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:28.363309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4db290-f322-4ae3-a590-8c08c3271178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:28.364519 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db290-f322-4ae3-a590-8c08c3271178 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:28.365029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db290-f322-4ae3-a590-8c08c3271178 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:28.365307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db290-f322-4ae3-a590-8c08c3271178 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:28.365948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4db290-f322-4ae3-a590-8c08c3271178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:28.366248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4db290-f322-4ae3-a590-8c08c3271178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:28.368948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4db290-f322-4ae3-a590-8c08c3271178 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:28.373461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483760f4-157a-49cb-a558-4a1bc959ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:28.374332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483760f4-157a-49cb-a558-4a1bc959ea58 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:28.374806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483760f4-157a-49cb-a558-4a1bc959ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:28.375265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483760f4-157a-49cb-a558-4a1bc959ea58 None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/81b6abdeca334777b597215dfe157688/roles/8f47585e7ab1400689facb80e605e850` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:28.385517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 297/603] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:28.386780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1165e-69ca-4b74-b892-34dd65c1ae9a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:28.387062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1165e-69ca-4b74-b892-34dd65c1ae9a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:28.387331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1165e-69ca-4b74-b892-34dd65c1ae9a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:28.392607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 298/604] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:28.392607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1165e-69ca-4b74-b892-34dd65c1ae9a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:28.399523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483760f4-157a-49cb-a558-4a1bc959ea58 None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=81b6abdeca334777b597215dfe157688, role_id=8f47585e7ab1400689facb80e605e850)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:28.401604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483760f4-157a-49cb-a558-4a1bc959ea58 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:28.501789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 307/605] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:13:28 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/81b6abdeca334777b597215dfe157688/roles/8f47585e7ab1400689facb80e605e850 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:13:28.503378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1165e-69ca-4b74-b892-34dd65c1ae9a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:28.509210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0306bb-9b77-4116-a1ae-870014974f4f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:28.509576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0306bb-9b77-4116-a1ae-870014974f4f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:28.509909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0306bb-9b77-4116-a1ae-870014974f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:28.548633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8870c-4b3b-4c48-b527-0c866ddf4279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:28.549620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8870c-4b3b-4c48-b527-0c866ddf4279 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:28.550037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4a0306bb-9b77-4116-a1ae-870014974f4f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:28.550293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8870c-4b3b-4c48-b527-0c866ddf4279 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:28.550807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8870c-4b3b-4c48-b527-0c866ddf4279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:28.551442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4a0306bb-9b77-4116-a1ae-870014974f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:28.559592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8870c-4b3b-4c48-b527-0c866ddf4279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:28.562639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8870c-4b3b-4c48-b527-0c866ddf4279 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-36e8870c-4b3b-4c48-b527-0c866ddf4279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:28.576967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:28.577893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:28.578764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:28.578764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:28.578764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:28.578764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:28.578764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:28.578764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:28.578764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:28.578764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:28.581274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 299/606] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:28.586481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8870c-4b3b-4c48-b527-0c866ddf4279 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:28.640329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:28.716049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8870c-4b3b-4c48-b527-0c866ddf4279 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:28.722545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 308/607] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:28.757342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d379a-e088-4b3a-a365-47077df210b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:28.758172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d379a-e088-4b3a-a365-47077df210b8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:28.758612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d379a-e088-4b3a-a365-47077df210b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:28.759020 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d379a-e088-4b3a-a365-47077df210b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:28.759930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d379a-e088-4b3a-a365-47077df210b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:28.760372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d379a-e088-4b3a-a365-47077df210b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:28.762019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d379a-e088-4b3a-a365-47077df210b8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:28.775601 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 300/608] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:28.781879 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0306bb-9b77-4116-a1ae-870014974f4f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:28.844123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:28.902687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0306bb-9b77-4116-a1ae-870014974f4f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:28.937083 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a166de-5b89-4bb1-8988-eb48a1548b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:28.937746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a166de-5b89-4bb1-8988-eb48a1548b7f None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:28.938033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a166de-5b89-4bb1-8988-eb48a1548b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:28.938310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a166de-5b89-4bb1-8988-eb48a1548b7f None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/81bb83de9f794ac9b02e5dca2df3e4d1/roles/8f47585e7ab1400689facb80e605e850` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:28.953645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a166de-5b89-4bb1-8988-eb48a1548b7f None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=81bb83de9f794ac9b02e5dca2df3e4d1, role_id=8f47585e7ab1400689facb80e605e850)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:28.955094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a166de-5b89-4bb1-8988-eb48a1548b7f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:29.036911 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 309/609] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:13:28 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/81bb83de9f794ac9b02e5dca2df3e4d1/roles/8f47585e7ab1400689facb80e605e850 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:13:29.046419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d379a-e088-4b3a-a365-47077df210b8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:29.178187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:29.183802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d379a-e088-4b3a-a365-47077df210b8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:29.221911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e71fb5-3b78-4b1d-a20f-fde2a6243c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:29.222546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71fb5-3b78-4b1d-a20f-fde2a6243c15 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:29.222817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71fb5-3b78-4b1d-a20f-fde2a6243c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:29.223083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71fb5-3b78-4b1d-a20f-fde2a6243c15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:29.235599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e71fb5-3b78-4b1d-a20f-fde2a6243c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-95e71fb5-3b78-4b1d-a20f-fde2a6243c15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:29.240492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:29.241381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:29.242492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 301/610] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:29.248110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a166de-5b89-4bb1-8988-eb48a1548b7f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:29.355388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:29.362468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a166de-5b89-4bb1-8988-eb48a1548b7f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:29.369475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948996bd-a955-4802-852d-8a2ae813d8ab None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:29.369752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948996bd-a955-4802-852d-8a2ae813d8ab None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:29.370009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948996bd-a955-4802-852d-8a2ae813d8ab None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:29.372156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 302/611] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:13:29.377117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2babc-f52e-4f4c-a286-07cc56aae959 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:29.378359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2babc-f52e-4f4c-a286-07cc56aae959 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:29.378359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2babc-f52e-4f4c-a286-07cc56aae959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:29.409353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-63c2babc-f52e-4f4c-a286-07cc56aae959 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:29.410565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-63c2babc-f52e-4f4c-a286-07cc56aae959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:29.437174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388374a-834e-46ac-988c-8da4c92ca1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:29.437784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388374a-834e-46ac-988c-8da4c92ca1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:29.438113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388374a-834e-46ac-988c-8da4c92ca1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:29.438384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388374a-834e-46ac-988c-8da4c92ca1d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:29.439046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388374a-834e-46ac-988c-8da4c92ca1d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:29.439389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388374a-834e-46ac-988c-8da4c92ca1d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:29.440779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388374a-834e-46ac-988c-8da4c92ca1d9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:29.457337 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 310/612] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:29.468160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388374a-834e-46ac-988c-8da4c92ca1d9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:29.523532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 303/613] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:29.617953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388374a-834e-46ac-988c-8da4c92ca1d9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:29.660930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20974-3063-412e-8e44-2ffb4ce795d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:29.661555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20974-3063-412e-8e44-2ffb4ce795d0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:29.661829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20974-3063-412e-8e44-2ffb4ce795d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:29.662099 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20974-3063-412e-8e44-2ffb4ce795d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:29.683583 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20974-3063-412e-8e44-2ffb4ce795d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:29.685071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20974-3063-412e-8e44-2ffb4ce795d0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d7b20974-3063-412e-8e44-2ffb4ce795d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:29.705526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:29.706471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:29.707341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:29.707341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:29.707341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:29.707341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 311/614] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:29.712497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2babc-f52e-4f4c-a286-07cc56aae959 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:29.731529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc66cef-11da-4b9d-8452-3dd1cefed63d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:29.731814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc66cef-11da-4b9d-8452-3dd1cefed63d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:29.732108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc66cef-11da-4b9d-8452-3dd1cefed63d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:29.733692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 312/615] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:29.738517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240439b-a787-44f4-8b24-ec1de4577b86 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:29.738795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240439b-a787-44f4-8b24-ec1de4577b86 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:29.739066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240439b-a787-44f4-8b24-ec1de4577b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:29.761370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7240439b-a787-44f4-8b24-ec1de4577b86 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:29.762556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7240439b-a787-44f4-8b24-ec1de4577b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:29.784240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:29.868519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 313/616] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:13:29.900252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:29.923670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2babc-f52e-4f4c-a286-07cc56aae959 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:29.979464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a439f7-afd9-4402-bcf7-1faaebb7f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:29.980643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a439f7-afd9-4402-bcf7-1faaebb7f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:29.980915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a439f7-afd9-4402-bcf7-1faaebb7f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:29.981184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a439f7-afd9-4402-bcf7-1faaebb7f3a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:29.981819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a439f7-afd9-4402-bcf7-1faaebb7f3a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:29.982112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a439f7-afd9-4402-bcf7-1faaebb7f3a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:29.983478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a439f7-afd9-4402-bcf7-1faaebb7f3a2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:29.986415 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240439b-a787-44f4-8b24-ec1de4577b86 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.002553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 304/617] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:30.008116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a439f7-afd9-4402-bcf7-1faaebb7f3a2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.168478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a439f7-afd9-4402-bcf7-1faaebb7f3a2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:30.170359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240439b-a787-44f4-8b24-ec1de4577b86 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:30.204468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32977383-357e-4dd8-a84a-6e9b2b83a22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:30.205291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977383-357e-4dd8-a84a-6e9b2b83a22a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:30.205565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977383-357e-4dd8-a84a-6e9b2b83a22a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:30.205833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977383-357e-4dd8-a84a-6e9b2b83a22a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:30.207230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddced43c-44ab-4a77-b180-582f90ea413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:30.207854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddced43c-44ab-4a77-b180-582f90ea413f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:30.208154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddced43c-44ab-4a77-b180-582f90ea413f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:30.208422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddced43c-44ab-4a77-b180-582f90ea413f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:30.215333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32977383-357e-4dd8-a84a-6e9b2b83a22a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:30.215652 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:30.217548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32977383-357e-4dd8-a84a-6e9b2b83a22a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:30.220409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddced43c-44ab-4a77-b180-582f90ea413f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ddced43c-44ab-4a77-b180-582f90ea413f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:30.225440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:30.228423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 314/618] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:30.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddced43c-44ab-4a77-b180-582f90ea413f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-32977383-357e-4dd8-a84a-6e9b2b83a22a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:30.233595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:30.235712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:30.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 305/619] 10.222.0.55 () {56 vars in 1093 bytes} [Fri Sep 2 09:13:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:30.242161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32977383-357e-4dd8-a84a-6e9b2b83a22a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.250461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:30.334320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddced43c-44ab-4a77-b180-582f90ea413f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:30.344887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32977383-357e-4dd8-a84a-6e9b2b83a22a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:30.370461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b3e65-a242-4de7-97b0-e96b215757de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:30.371182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b3e65-a242-4de7-97b0-e96b215757de None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:30.371526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b3e65-a242-4de7-97b0-e96b215757de None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:30.371867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b3e65-a242-4de7-97b0-e96b215757de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:30.382347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7ed01-2c59-484f-86a0-1f6644379b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:30.384003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7ed01-2c59-484f-86a0-1f6644379b12 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:30.384003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7ed01-2c59-484f-86a0-1f6644379b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:30.384003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7ed01-2c59-484f-86a0-1f6644379b12 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:30.384396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7ed01-2c59-484f-86a0-1f6644379b12 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:30.384544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7ed01-2c59-484f-86a0-1f6644379b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:30.385160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b3e65-a242-4de7-97b0-e96b215757de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:30.386565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7ed01-2c59-484f-86a0-1f6644379b12 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-509b3e65-a242-4de7-97b0-e96b215757de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:30.391192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:30.393110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:30.394903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 315/620] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:30.396364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b3e65-a242-4de7-97b0-e96b215757de None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.401045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 306/621] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:30.402462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7ed01-2c59-484f-86a0-1f6644379b12 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.481271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:30.481857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:30.499972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b3e65-a242-4de7-97b0-e96b215757de None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:30.513386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7ed01-2c59-484f-86a0-1f6644379b12 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:30.535677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b2f69-8494-490f-9dc3-5fdc79fe608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:30.536440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b2f69-8494-490f-9dc3-5fdc79fe608d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:30.536716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b2f69-8494-490f-9dc3-5fdc79fe608d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:30.536984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b2f69-8494-490f-9dc3-5fdc79fe608d None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:30.537703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b2f69-8494-490f-9dc3-5fdc79fe608d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:30.538000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b2f69-8494-490f-9dc3-5fdc79fe608d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:30.539431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b2f69-8494-490f-9dc3-5fdc79fe608d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:30.550259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446edef-ad1b-4087-8808-bd58dbd862bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:30.550915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446edef-ad1b-4087-8808-bd58dbd862bd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:30.551194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446edef-ad1b-4087-8808-bd58dbd862bd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:30.551463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446edef-ad1b-4087-8808-bd58dbd862bd None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:30.552204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446edef-ad1b-4087-8808-bd58dbd862bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:30.552500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446edef-ad1b-4087-8808-bd58dbd862bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:30.553979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446edef-ad1b-4087-8808-bd58dbd862bd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:30.558303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 316/622] 10.222.0.55 () {56 vars in 1133 bytes} [Fri Sep 2 09:13:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:30.559348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b2f69-8494-490f-9dc3-5fdc79fe608d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.564493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 307/623] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:30.565318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446edef-ad1b-4087-8808-bd58dbd862bd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.662584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b2f69-8494-490f-9dc3-5fdc79fe608d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:30.679406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:30.681419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446edef-ad1b-4087-8808-bd58dbd862bd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:30.697544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce258f-2ca9-4c09-86c3-9a6a5d3837bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:30.698180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce258f-2ca9-4c09-86c3-9a6a5d3837bc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:30.698976 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce258f-2ca9-4c09-86c3-9a6a5d3837bc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:30.699254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce258f-2ca9-4c09-86c3-9a6a5d3837bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:30.709532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce258f-2ca9-4c09-86c3-9a6a5d3837bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:30.710974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce258f-2ca9-4c09-86c3-9a6a5d3837bc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:30.713303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:30.719153 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1949395-2809-4294-89e8-e2e539e4996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:30.719760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1949395-2809-4294-89e8-e2e539e4996e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:30.720078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1949395-2809-4294-89e8-e2e539e4996e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:30.720352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1949395-2809-4294-89e8-e2e539e4996e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e6ce258f-2ca9-4c09-86c3-9a6a5d3837bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:30.726791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:30.728757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:30.731541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:30.731541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:30.731541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:30.735920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 317/624] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:30.735920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce258f-2ca9-4c09-86c3-9a6a5d3837bc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.801792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1949395-2809-4294-89e8-e2e539e4996e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:30.803266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1949395-2809-4294-89e8-e2e539e4996e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:30.844470 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce258f-2ca9-4c09-86c3-9a6a5d3837bc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:30.880158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a840a-2132-4ad9-a52f-7e81adf87f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:30.880849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a840a-2132-4ad9-a52f-7e81adf87f36 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:30.881117 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a840a-2132-4ad9-a52f-7e81adf87f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:30.881436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a840a-2132-4ad9-a52f-7e81adf87f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:30.893146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a840a-2132-4ad9-a52f-7e81adf87f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:30.894675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a840a-2132-4ad9-a52f-7e81adf87f36 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-896a840a-2132-4ad9-a52f-7e81adf87f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:30.909707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:30.910858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:30.911850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:30.911850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:30.911850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:30.915692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 318/625] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:30.916577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a840a-2132-4ad9-a52f-7e81adf87f36 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.919069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 308/626] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:30.920389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1949395-2809-4294-89e8-e2e539e4996e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:30.940690 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:30.955271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:31.021092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a840a-2132-4ad9-a52f-7e81adf87f36 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.028685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1949395-2809-4294-89e8-e2e539e4996e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.055847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bc5ed-0f6d-458b-8396-462b8d944a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.056740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bc5ed-0f6d-458b-8396-462b8d944a29 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.057017 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bc5ed-0f6d-458b-8396-462b8d944a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.057290 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bc5ed-0f6d-458b-8396-462b8d944a29 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.058442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bc5ed-0f6d-458b-8396-462b8d944a29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:31.058745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bc5ed-0f6d-458b-8396-462b8d944a29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:31.060128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bc5ed-0f6d-458b-8396-462b8d944a29 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:31.064966 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1afa1-da02-4e7c-b274-f71ed9f73965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.065766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1afa1-da02-4e7c-b274-f71ed9f73965 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.066212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1afa1-da02-4e7c-b274-f71ed9f73965 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.066686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1afa1-da02-4e7c-b274-f71ed9f73965 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.067538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1afa1-da02-4e7c-b274-f71ed9f73965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:31.068054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1afa1-da02-4e7c-b274-f71ed9f73965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:31.069691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1afa1-da02-4e7c-b274-f71ed9f73965 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:31.071716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 319/627] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:31.071716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bc5ed-0f6d-458b-8396-462b8d944a29 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:31.087632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 309/628] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:31.089697 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a2867-bc6c-438d-a3b6-14dd3446a3b2 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.090217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a2867-bc6c-438d-a3b6-14dd3446a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.090800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a2867-bc6c-438d-a3b6-14dd3446a3b2 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.093118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 310/629] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:31.094081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a2867-bc6c-438d-a3b6-14dd3446a3b2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:31.161233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:31.180805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bc5ed-0f6d-458b-8396-462b8d944a29 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.191431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:31.200917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a2867-bc6c-438d-a3b6-14dd3446a3b2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.218818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c91e80-0833-4e92-b220-8d1dc425d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.219449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c91e80-0833-4e92-b220-8d1dc425d81f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.219727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c91e80-0833-4e92-b220-8d1dc425d81f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.220027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c91e80-0833-4e92-b220-8d1dc425d81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.230846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c91e80-0833-4e92-b220-8d1dc425d81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:31.232340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c91e80-0833-4e92-b220-8d1dc425d81f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:31.238540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac0e6-e80e-4999-80d2-1307d6ffe884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.239738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac0e6-e80e-4999-80d2-1307d6ffe884 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.240203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac0e6-e80e-4999-80d2-1307d6ffe884 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.240656 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac0e6-e80e-4999-80d2-1307d6ffe884 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-19c91e80-0833-4e92-b220-8d1dc425d81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:31.248179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:31.249282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:31.250184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:31.250184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:31.250184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:31.250184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 320/630] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:31.250412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c91e80-0833-4e92-b220-8d1dc425d81f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:31.251909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ac0e6-e80e-4999-80d2-1307d6ffe884 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:31.253393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ac0e6-e80e-4999-80d2-1307d6ffe884 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-243ac0e6-e80e-4999-80d2-1307d6ffe884 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:31.265225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:31.266196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:31.267151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:31.267151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:31.267151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:31.267151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:31.267151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:31.267151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:31.267151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:31.267151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:31.267151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:31.267151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:31.268026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 311/631] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:31.269566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a42610-b1ba-4e31-be9b-9f50f7d2f651 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.269847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a42610-b1ba-4e31-be9b-9f50f7d2f651 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.270117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a42610-b1ba-4e31-be9b-9f50f7d2f651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.287834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-67a42610-b1ba-4e31-be9b-9f50f7d2f651 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:31.289039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-67a42610-b1ba-4e31-be9b-9f50f7d2f651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:31.354248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 312/632] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:31.355857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a42610-b1ba-4e31-be9b-9f50f7d2f651 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:31.359065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c91e80-0833-4e92-b220-8d1dc425d81f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.389183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:31.394574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de461dce-77f8-44fc-a0df-3e0013185d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.395199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de461dce-77f8-44fc-a0df-3e0013185d6a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.395478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de461dce-77f8-44fc-a0df-3e0013185d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.395751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de461dce-77f8-44fc-a0df-3e0013185d6a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.403116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de461dce-77f8-44fc-a0df-3e0013185d6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:31.404608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de461dce-77f8-44fc-a0df-3e0013185d6a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-de461dce-77f8-44fc-a0df-3e0013185d6a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:31.416291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:31.423395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 321/633] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:31.424875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de461dce-77f8-44fc-a0df-3e0013185d6a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:31.459264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:31.477574 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a42610-b1ba-4e31-be9b-9f50f7d2f651 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.513948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f7556-0444-4617-8a83-433fc072b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.514548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f7556-0444-4617-8a83-433fc072b626 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.514818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f7556-0444-4617-8a83-433fc072b626 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.515083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f7556-0444-4617-8a83-433fc072b626 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.515824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f7556-0444-4617-8a83-433fc072b626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:31.516141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f7556-0444-4617-8a83-433fc072b626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:31.517605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f7556-0444-4617-8a83-433fc072b626 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:31.522223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de461dce-77f8-44fc-a0df-3e0013185d6a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.532103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 313/634] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:31.533285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39c332-689e-40bd-924c-6da08e2bbcd6 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.533564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39c332-689e-40bd-924c-6da08e2bbcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.533835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39c332-689e-40bd-924c-6da08e2bbcd6 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.535137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 314/635] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:31.535694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39c332-689e-40bd-924c-6da08e2bbcd6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:31.565694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d717bb-6684-4553-9293-f615ce5f74da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.566229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d717bb-6684-4553-9293-f615ce5f74da None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.566506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d717bb-6684-4553-9293-f615ce5f74da None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.566777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d717bb-6684-4553-9293-f615ce5f74da None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.567493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d717bb-6684-4553-9293-f615ce5f74da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:31.567798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d717bb-6684-4553-9293-f615ce5f74da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:31.569257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d717bb-6684-4553-9293-f615ce5f74da None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:31.586004 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 322/636] 10.222.0.55 () {56 vars in 1135 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:31.586792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d717bb-6684-4553-9293-f615ce5f74da None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:31.636554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:31.654281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39c332-689e-40bd-924c-6da08e2bbcd6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.687009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d717bb-6684-4553-9293-f615ce5f74da None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.689093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95931e-c8c5-4f45-8387-4c45a1733a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.689735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95931e-c8c5-4f45-8387-4c45a1733a5d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.690032 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95931e-c8c5-4f45-8387-4c45a1733a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.690301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95931e-c8c5-4f45-8387-4c45a1733a5d None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.691023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95931e-c8c5-4f45-8387-4c45a1733a5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:31.691327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95931e-c8c5-4f45-8387-4c45a1733a5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:31.692822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95931e-c8c5-4f45-8387-4c45a1733a5d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:31.706360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:31.710140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 315/637] 10.222.0.55 () {56 vars in 1137 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:31.711188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45a65a-b9a0-4544-9879-1a4ffc1306c0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.711468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45a65a-b9a0-4544-9879-1a4ffc1306c0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.711742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45a65a-b9a0-4544-9879-1a4ffc1306c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.722787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db384030-f67b-4326-882d-84542cd780ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.723404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384030-f67b-4326-882d-84542cd780ee None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.723678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384030-f67b-4326-882d-84542cd780ee None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.723983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384030-f67b-4326-882d-84542cd780ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.729056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-bd45a65a-b9a0-4544-9879-1a4ffc1306c0 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:31.730796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bd45a65a-b9a0-4544-9879-1a4ffc1306c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:31.731076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db384030-f67b-4326-882d-84542cd780ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:31.732537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db384030-f67b-4326-882d-84542cd780ee None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-db384030-f67b-4326-882d-84542cd780ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:31.743637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:31.744650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:31.745564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:31.745564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:31.745564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:31.745564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:31.745564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:31.745564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:31.745564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:31.745564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:31.745564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 323/638] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:31.745564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db384030-f67b-4326-882d-84542cd780ee None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:31.801276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 316/639] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:31.802125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45a65a-b9a0-4544-9879-1a4ffc1306c0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:31.864649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db384030-f67b-4326-882d-84542cd780ee None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.876338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:31.900482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf337bf-d353-4951-bf7d-558132fc3913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.901101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf337bf-d353-4951-bf7d-558132fc3913 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.901377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf337bf-d353-4951-bf7d-558132fc3913 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.902193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf337bf-d353-4951-bf7d-558132fc3913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.905006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45a65a-b9a0-4544-9879-1a4ffc1306c0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:31.912474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf337bf-d353-4951-bf7d-558132fc3913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:31.913923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf337bf-d353-4951-bf7d-558132fc3913 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-bbf337bf-d353-4951-bf7d-558132fc3913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:31.928507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:31.929436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:31.930307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:31.930307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:31.930307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:31.930307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 324/640] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:31.930526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf337bf-d353-4951-bf7d-558132fc3913 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:31.940173 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:31.946369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebe07b-19e4-41dc-b325-dba3932e6f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:31.947001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebe07b-19e4-41dc-b325-dba3932e6f1b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:31.947276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebe07b-19e4-41dc-b325-dba3932e6f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:31.947545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebe07b-19e4-41dc-b325-dba3932e6f1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:31.958121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebe07b-19e4-41dc-b325-dba3932e6f1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bcebe07b-19e4-41dc-b325-dba3932e6f1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:31.963573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:31.965303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 317/641] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:31.966130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebe07b-19e4-41dc-b325-dba3932e6f1b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.045298 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf337bf-d353-4951-bf7d-558132fc3913 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.065695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebe07b-19e4-41dc-b325-dba3932e6f1b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.080615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673fcaa-6e8b-41e0-8a0b-503c36f1f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.081219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673fcaa-6e8b-41e0-8a0b-503c36f1f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.081497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673fcaa-6e8b-41e0-8a0b-503c36f1f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.081766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673fcaa-6e8b-41e0-8a0b-503c36f1f9b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.099953 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472c2e4-de2a-4270-bff5-10c94196caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.100510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c2e4-de2a-4270-bff5-10c94196caa1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.100779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c2e4-de2a-4270-bff5-10c94196caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.101048 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c2e4-de2a-4270-bff5-10c94196caa1 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.101724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472c2e4-de2a-4270-bff5-10c94196caa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:32.102020 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472c2e4-de2a-4270-bff5-10c94196caa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:32.103480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472c2e4-de2a-4270-bff5-10c94196caa1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:32.111243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:32.114908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 318/642] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:32.115689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472c2e4-de2a-4270-bff5-10c94196caa1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.150096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673fcaa-6e8b-41e0-8a0b-503c36f1f9b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:32.152166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673fcaa-6e8b-41e0-8a0b-503c36f1f9b3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:32.168532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:32.216750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472c2e4-de2a-4270-bff5-10c94196caa1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.251792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 325/643] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:32.251792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673fcaa-6e8b-41e0-8a0b-503c36f1f9b3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.252077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb9655-81e8-468a-b5ee-7e2ffd7591a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.252077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9655-81e8-468a-b5ee-7e2ffd7591a8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.252077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9655-81e8-468a-b5ee-7e2ffd7591a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.252077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9655-81e8-468a-b5ee-7e2ffd7591a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.252353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb9655-81e8-468a-b5ee-7e2ffd7591a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:32.252353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb9655-81e8-468a-b5ee-7e2ffd7591a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:32.252801 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb9655-81e8-468a-b5ee-7e2ffd7591a8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:32.264903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 319/644] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:32.265700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb9655-81e8-468a-b5ee-7e2ffd7591a8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.308434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:32.345523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673fcaa-6e8b-41e0-8a0b-503c36f1f9b3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.361748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb9655-81e8-468a-b5ee-7e2ffd7591a8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.373118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:32.379167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541df885-35d4-428d-8efb-ab8fe7a03aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.379762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541df885-35d4-428d-8efb-ab8fe7a03aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.380065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541df885-35d4-428d-8efb-ab8fe7a03aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.380333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541df885-35d4-428d-8efb-ab8fe7a03aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.381076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541df885-35d4-428d-8efb-ab8fe7a03aa7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:32.381268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541df885-35d4-428d-8efb-ab8fe7a03aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:32.382612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541df885-35d4-428d-8efb-ab8fe7a03aa7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:32.390856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 326/645] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:32.391553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541df885-35d4-428d-8efb-ab8fe7a03aa7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.399121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b99899-a90f-4059-9d85-aa1f6cc8bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.399755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b99899-a90f-4059-9d85-aa1f6cc8bf7e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.400076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b99899-a90f-4059-9d85-aa1f6cc8bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.400353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b99899-a90f-4059-9d85-aa1f6cc8bf7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.411785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b99899-a90f-4059-9d85-aa1f6cc8bf7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e0b99899-a90f-4059-9d85-aa1f6cc8bf7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:32.416647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:32.417595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 320/646] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:32.418552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b99899-a90f-4059-9d85-aa1f6cc8bf7e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.491559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541df885-35d4-428d-8efb-ab8fe7a03aa7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.514931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:32.517691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b99899-a90f-4059-9d85-aa1f6cc8bf7e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.525387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ef445-f518-46e7-b102-eb198c8a29df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.525985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ef445-f518-46e7-b102-eb198c8a29df None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.526271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ef445-f518-46e7-b102-eb198c8a29df None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.526542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ef445-f518-46e7-b102-eb198c8a29df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.528103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ef445-f518-46e7-b102-eb198c8a29df None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=5d74d78932554527a8bcb5880b2b9c96) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:32.528103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ef445-f518-46e7-b102-eb198c8a29df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:32.529033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ef445-f518-46e7-b102-eb198c8a29df None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:32.534661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 327/647] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/role_assignments?user.id=5d74d78932554527a8bcb5880b2b9c96&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:32.535434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ef445-f518-46e7-b102-eb198c8a29df None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.552684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135ecf-d797-4eee-a44a-0a4ed5ca4588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.553462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135ecf-d797-4eee-a44a-0a4ed5ca4588 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.553645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135ecf-d797-4eee-a44a-0a4ed5ca4588 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.553866 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135ecf-d797-4eee-a44a-0a4ed5ca4588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.566894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25135ecf-d797-4eee-a44a-0a4ed5ca4588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:32.568425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25135ecf-d797-4eee-a44a-0a4ed5ca4588 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-25135ecf-d797-4eee-a44a-0a4ed5ca4588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:32.585694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:32.586731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:32.592561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:32.592561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:32.592561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:32.592561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 321/648] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:32.592561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135ecf-d797-4eee-a44a-0a4ed5ca4588 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.619119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:32.654200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ef445-f518-46e7-b102-eb198c8a29df None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.695875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700c28e-d738-41bc-a2da-d3106b553886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.696711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700c28e-d738-41bc-a2da-d3106b553886 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.696988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700c28e-d738-41bc-a2da-d3106b553886 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.697263 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700c28e-d738-41bc-a2da-d3106b553886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.705495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135ecf-d797-4eee-a44a-0a4ed5ca4588 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.705790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700c28e-d738-41bc-a2da-d3106b553886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:32.707421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700c28e-d738-41bc-a2da-d3106b553886 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8700c28e-d738-41bc-a2da-d3106b553886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:32.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:32.721950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:32.722847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:32.722847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:32.722847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:32.722847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:32.722847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:32.722847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:32.722847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:32.722847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:32.722847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 328/649] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:32.723329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700c28e-d738-41bc-a2da-d3106b553886 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.749263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f86c14-d204-4574-883a-02d6e2d96bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.749909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86c14-d204-4574-883a-02d6e2d96bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.750189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86c14-d204-4574-883a-02d6e2d96bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.750462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86c14-d204-4574-883a-02d6e2d96bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.761790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f86c14-d204-4574-883a-02d6e2d96bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:32.763276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f86c14-d204-4574-883a-02d6e2d96bf6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-33f86c14-d204-4574-883a-02d6e2d96bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:32.777868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:32.778829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:32.779701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:32.779701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:32.779701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:32.779701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 322/650] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:32.780419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f86c14-d204-4574-883a-02d6e2d96bf6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.786469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:32.845777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700c28e-d738-41bc-a2da-d3106b553886 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.862141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:32.883438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66270-2ca4-4eec-bd16-e9929a195369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.884142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66270-2ca4-4eec-bd16-e9929a195369 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.884425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66270-2ca4-4eec-bd16-e9929a195369 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.884794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66270-2ca4-4eec-bd16-e9929a195369 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.885355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e66270-2ca4-4eec-bd16-e9929a195369 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:32.885660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e66270-2ca4-4eec-bd16-e9929a195369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:32.887173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e66270-2ca4-4eec-bd16-e9929a195369 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:32.888752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f86c14-d204-4574-883a-02d6e2d96bf6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:32.895845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 329/651] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:32.896689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66270-2ca4-4eec-bd16-e9929a195369 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:32.929760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e330caf-8572-4648-bb7f-f1044925b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:32.930460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e330caf-8572-4648-bb7f-f1044925b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:32.930818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e330caf-8572-4648-bb7f-f1044925b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:32.931156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e330caf-8572-4648-bb7f-f1044925b9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:32.931868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e330caf-8572-4648-bb7f-f1044925b9d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:32.932198 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e330caf-8572-4648-bb7f-f1044925b9d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:32.934158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e330caf-8572-4648-bb7f-f1044925b9d3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:32.948021 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 323/652] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:32.948704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e330caf-8572-4648-bb7f-f1044925b9d3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.009824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66270-2ca4-4eec-bd16-e9929a195369 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.020339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:33.050060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134d83f-b0dd-404c-917a-03907afa3b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:33.050802 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134d83f-b0dd-404c-917a-03907afa3b5e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:33.051152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134d83f-b0dd-404c-917a-03907afa3b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:33.051493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134d83f-b0dd-404c-917a-03907afa3b5e None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:33.052282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134d83f-b0dd-404c-917a-03907afa3b5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:33.052661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134d83f-b0dd-404c-917a-03907afa3b5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:33.054148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134d83f-b0dd-404c-917a-03907afa3b5e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:33.056358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e330caf-8572-4648-bb7f-f1044925b9d3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.066872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 330/653] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:33.072430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134d83f-b0dd-404c-917a-03907afa3b5e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.092109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57196aaa-5151-4b89-b616-feb8f4e6113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:33.092838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57196aaa-5151-4b89-b616-feb8f4e6113e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:33.093175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57196aaa-5151-4b89-b616-feb8f4e6113e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:33.093537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57196aaa-5151-4b89-b616-feb8f4e6113e None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:33.094265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57196aaa-5151-4b89-b616-feb8f4e6113e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:33.094775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57196aaa-5151-4b89-b616-feb8f4e6113e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:33.096120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57196aaa-5151-4b89-b616-feb8f4e6113e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:33.097808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:33.113191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 324/654] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:33.113191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57196aaa-5151-4b89-b616-feb8f4e6113e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.184740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134d83f-b0dd-404c-917a-03907afa3b5e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.219611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57196aaa-5151-4b89-b616-feb8f4e6113e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.223033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf9d0f-efa8-4cd2-9c48-aa9649afc40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:33.223737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf9d0f-efa8-4cd2-9c48-aa9649afc40f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:33.224110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf9d0f-efa8-4cd2-9c48-aa9649afc40f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:33.224448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf9d0f-efa8-4cd2-9c48-aa9649afc40f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:33.236727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf9d0f-efa8-4cd2-9c48-aa9649afc40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:33.238255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf9d0f-efa8-4cd2-9c48-aa9649afc40f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-65cf9d0f-efa8-4cd2-9c48-aa9649afc40f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:33.253549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:33.254486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:33.255372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:33.255372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:33.255372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:33.255372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 331/655] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:33.256132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf9d0f-efa8-4cd2-9c48-aa9649afc40f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.261361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133c225-1eec-496d-ac3c-587cb6423d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:33.262001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c225-1eec-496d-ac3c-587cb6423d80 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:33.262276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c225-1eec-496d-ac3c-587cb6423d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:33.262543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c225-1eec-496d-ac3c-587cb6423d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:33.270542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133c225-1eec-496d-ac3c-587cb6423d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:33.272511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133c225-1eec-496d-ac3c-587cb6423d80 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:33.281084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7133c225-1eec-496d-ac3c-587cb6423d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:33.286809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:33.300525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:33.301410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:33.301410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:33.301410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:33.301410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:33.301410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:33.301410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:33.301410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:33.301410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:33.301410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 325/656] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:33.301410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133c225-1eec-496d-ac3c-587cb6423d80 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.351898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:33.363232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf9d0f-efa8-4cd2-9c48-aa9649afc40f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.398498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c7a5-acc1-47e1-a23e-be47a2b49a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:33.399130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c7a5-acc1-47e1-a23e-be47a2b49a4f None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:33.399388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c7a5-acc1-47e1-a23e-be47a2b49a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:33.399589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c7a5-acc1-47e1-a23e-be47a2b49a4f None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/01367d6c12014bc0bc9410b4a5a98693/roles/8f47585e7ab1400689facb80e605e850` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:33.401161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133c225-1eec-496d-ac3c-587cb6423d80 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.414475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5c7a5-acc1-47e1-a23e-be47a2b49a4f None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=01367d6c12014bc0bc9410b4a5a98693, role_id=8f47585e7ab1400689facb80e605e850)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:33.415914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5c7a5-acc1-47e1-a23e-be47a2b49a4f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:33.437848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249a089-eb9f-42c0-8bc8-1acfd0184466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:33.437848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249a089-eb9f-42c0-8bc8-1acfd0184466 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:33.437848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249a089-eb9f-42c0-8bc8-1acfd0184466 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:33.437848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249a089-eb9f-42c0-8bc8-1acfd0184466 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:33.444434 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249a089-eb9f-42c0-8bc8-1acfd0184466 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:33.445874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249a089-eb9f-42c0-8bc8-1acfd0184466 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d249a089-eb9f-42c0-8bc8-1acfd0184466 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:33.457422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:33.458617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 326/657] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:33.459583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249a089-eb9f-42c0-8bc8-1acfd0184466 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.489497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 332/658] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:13:33 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/01367d6c12014bc0bc9410b4a5a98693/roles/8f47585e7ab1400689facb80e605e850 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:13:33.490489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c7a5-acc1-47e1-a23e-be47a2b49a4f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.588510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249a089-eb9f-42c0-8bc8-1acfd0184466 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.589009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:33.604716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:33.616808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c7a5-acc1-47e1-a23e-be47a2b49a4f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.639524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ba364-0da0-4de4-a29d-ae1fe66fd281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:33.640583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ba364-0da0-4de4-a29d-ae1fe66fd281 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:33.641017 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ba364-0da0-4de4-a29d-ae1fe66fd281 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:33.641463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ba364-0da0-4de4-a29d-ae1fe66fd281 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:33.642257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ba364-0da0-4de4-a29d-ae1fe66fd281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:33.642702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ba364-0da0-4de4-a29d-ae1fe66fd281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:33.644345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ba364-0da0-4de4-a29d-ae1fe66fd281 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:33.660280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 327/659] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:33.661366 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ba364-0da0-4de4-a29d-ae1fe66fd281 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.664258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfded957-7eda-4bbe-90ba-29c9fa8f8fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:33.664258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfded957-7eda-4bbe-90ba-29c9fa8f8fec None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:33.664258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfded957-7eda-4bbe-90ba-29c9fa8f8fec None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:33.664258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfded957-7eda-4bbe-90ba-29c9fa8f8fec None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:33.664597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfded957-7eda-4bbe-90ba-29c9fa8f8fec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:33.664677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfded957-7eda-4bbe-90ba-29c9fa8f8fec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:33.666116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfded957-7eda-4bbe-90ba-29c9fa8f8fec None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:33.679854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 333/660] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:33.681297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfded957-7eda-4bbe-90ba-29c9fa8f8fec None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.793836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfded957-7eda-4bbe-90ba-29c9fa8f8fec None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.806344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ba364-0da0-4de4-a29d-ae1fe66fd281 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.834767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:33.845334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09c7fd-fbe4-404b-9e08-0c32acdffb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:33.851759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09c7fd-fbe4-404b-9e08-0c32acdffb4d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:33.851759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09c7fd-fbe4-404b-9e08-0c32acdffb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:33.851759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09c7fd-fbe4-404b-9e08-0c32acdffb4d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:33.856724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673cc0c-1feb-4779-a15f-d9d053e64ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:33.857692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09c7fd-fbe4-404b-9e08-0c32acdffb4d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:33.857968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673cc0c-1feb-4779-a15f-d9d053e64ced None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:33.858389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673cc0c-1feb-4779-a15f-d9d053e64ced None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:33.858914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673cc0c-1feb-4779-a15f-d9d053e64ced None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:33.859201 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09c7fd-fbe4-404b-9e08-0c32acdffb4d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:33.860059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673cc0c-1feb-4779-a15f-d9d053e64ced None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:33.860467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673cc0c-1feb-4779-a15f-d9d053e64ced None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:33.861982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673cc0c-1feb-4779-a15f-d9d053e64ced None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2c09c7fd-fbe4-404b-9e08-0c32acdffb4d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:33.871925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:33.873037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:33.874698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:33.874698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:33.874698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:33.874698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:33.874698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:33.874698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:33.874698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:33.874698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:33.874698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 09:13:33.874698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:33.883573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 334/661] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:33.883573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09c7fd-fbe4-404b-9e08-0c32acdffb4d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.888012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 328/662] 10.222.0.55 () {56 vars in 1137 bytes} [Fri Sep 2 09:13:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:33.888907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673cc0c-1feb-4779-a15f-d9d053e64ced None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:33.923869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:33.985608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09c7fd-fbe4-404b-9e08-0c32acdffb4d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:33.996972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673cc0c-1feb-4779-a15f-d9d053e64ced None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:34.023026 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec91f-0b91-4c34-b469-e744d87a11ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:34.023632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec91f-0b91-4c34-b469-e744d87a11ca None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:34.023942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec91f-0b91-4c34-b469-e744d87a11ca None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:34.024223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec91f-0b91-4c34-b469-e744d87a11ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:34.024950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec91f-0b91-4c34-b469-e744d87a11ca None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=2a6267b159204df7af8a4f84d227f88b) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:34.025255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec91f-0b91-4c34-b469-e744d87a11ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:34.026706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec91f-0b91-4c34-b469-e744d87a11ca None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:34.037654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 335/663] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:33 2022] GET /identity/v3/role_assignments?user.id=2a6267b159204df7af8a4f84d227f88b&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:34.037654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec91f-0b91-4c34-b469-e744d87a11ca None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:34.040499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dafb4-5fce-48d2-8a74-91054f0a79ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:34.042995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dafb4-5fce-48d2-8a74-91054f0a79ae None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:34.042995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dafb4-5fce-48d2-8a74-91054f0a79ae None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:34.042995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dafb4-5fce-48d2-8a74-91054f0a79ae None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:34.042995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dafb4-5fce-48d2-8a74-91054f0a79ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:34.042995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dafb4-5fce-48d2-8a74-91054f0a79ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:34.044286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dafb4-5fce-48d2-8a74-91054f0a79ae None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:34.081939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 329/664] 10.222.0.55 () {56 vars in 1139 bytes} [Fri Sep 2 09:13:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:34.089974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dafb4-5fce-48d2-8a74-91054f0a79ae None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:34.149515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:34.233771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec91f-0b91-4c34-b469-e744d87a11ca None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:34.234707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:34.245305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dafb4-5fce-48d2-8a74-91054f0a79ae None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:34.278387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19842f3b-3e37-4519-872a-b2d512116c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:34.279433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19842f3b-3e37-4519-872a-b2d512116c1e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:34.279964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19842f3b-3e37-4519-872a-b2d512116c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:34.280532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19842f3b-3e37-4519-872a-b2d512116c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:34.286897 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f314a-bcfc-47f8-8889-c4afcdd12b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:34.287581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f314a-bcfc-47f8-8889-c4afcdd12b8c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:34.287961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f314a-bcfc-47f8-8889-c4afcdd12b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:34.288303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f314a-bcfc-47f8-8889-c4afcdd12b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:34.374996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19842f3b-3e37-4519-872a-b2d512116c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:34.375974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f314a-bcfc-47f8-8889-c4afcdd12b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:34.376983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19842f3b-3e37-4519-872a-b2d512116c1e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:34.377566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f314a-bcfc-47f8-8889-c4afcdd12b8c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:34.438084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:34.475345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:34.491248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 330/665] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:34.491425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 336/666] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:34.491530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f314a-bcfc-47f8-8889-c4afcdd12b8c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:34.496853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19842f3b-3e37-4519-872a-b2d512116c1e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:34.602959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19842f3b-3e37-4519-872a-b2d512116c1e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:34.603285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f314a-bcfc-47f8-8889-c4afcdd12b8c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:34.641289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed4c4f-c1cb-490f-9cae-60aabf7bf0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:34.642348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4c4f-c1cb-490f-9cae-60aabf7bf0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:34.642796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4c4f-c1cb-490f-9cae-60aabf7bf0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:34.643243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4c4f-c1cb-490f-9cae-60aabf7bf0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:34.645882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ad34d-d316-43fd-8062-c334d964b7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:34.646994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad34d-d316-43fd-8062-c334d964b7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:34.647341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad34d-d316-43fd-8062-c334d964b7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:34.647682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad34d-d316-43fd-8062-c334d964b7e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:34.658787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed4c4f-c1cb-490f-9cae-60aabf7bf0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:34.660203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ad34d-d316-43fd-8062-c334d964b7e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:34.660747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed4c4f-c1cb-490f-9cae-60aabf7bf0e9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:34.661781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ad34d-d316-43fd-8062-c334d964b7e9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-95ed4c4f-c1cb-490f-9cae-60aabf7bf0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:34.676773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:34.677921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:34.678998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:34.678998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:34.678998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:34.680845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 337/667] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-435ad34d-d316-43fd-8062-c334d964b7e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:34.681110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:34.682181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:34.683316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:34.683316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:34.683316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:34.692290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 331/668] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:34.692436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1aa5c-226c-4465-b5b8-b3a6a69d85bb None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:34.692436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1aa5c-226c-4465-b5b8-b3a6a69d85bb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:34.692436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1aa5c-226c-4465-b5b8-b3a6a69d85bb None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:34.692436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 338/669] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:34.692704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ad34d-d316-43fd-8062-c334d964b7e9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:34.696883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1aa5c-226c-4465-b5b8-b3a6a69d85bb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:34.709669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:34.742181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:34.806663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ad34d-d316-43fd-8062-c334d964b7e9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:34.827966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1aa5c-226c-4465-b5b8-b3a6a69d85bb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:34.853637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab52469-dd49-4523-bc89-9ae1c886b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:34.854644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52469-dd49-4523-bc89-9ae1c886b362 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:34.855689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52469-dd49-4523-bc89-9ae1c886b362 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:34.856218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52469-dd49-4523-bc89-9ae1c886b362 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:34.857092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab52469-dd49-4523-bc89-9ae1c886b362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:34.857583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab52469-dd49-4523-bc89-9ae1c886b362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:34.859360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab52469-dd49-4523-bc89-9ae1c886b362 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:34.867278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f37eae-f4df-4278-bc2e-5fde8eefae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:34.868599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37eae-f4df-4278-bc2e-5fde8eefae89 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:34.868910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37eae-f4df-4278-bc2e-5fde8eefae89 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:34.869196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37eae-f4df-4278-bc2e-5fde8eefae89 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:34.870010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f37eae-f4df-4278-bc2e-5fde8eefae89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:34.870328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f37eae-f4df-4278-bc2e-5fde8eefae89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:34.872751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f37eae-f4df-4278-bc2e-5fde8eefae89 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:34.880031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 332/670] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:34.881712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd7285-7401-4b71-aada-6c665a2e2c4f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:34.882307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd7285-7401-4b71-aada-6c665a2e2c4f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:34.882774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd7285-7401-4b71-aada-6c665a2e2c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:34.885958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 339/671] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:34.890877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f37eae-f4df-4278-bc2e-5fde8eefae89 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:34.909474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e8cd7285-7401-4b71-aada-6c665a2e2c4f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:34.911016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e8cd7285-7401-4b71-aada-6c665a2e2c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:34.964289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:34.994897 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 333/672] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:34.996506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd7285-7401-4b71-aada-6c665a2e2c4f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:35.008070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f37eae-f4df-4278-bc2e-5fde8eefae89 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:35.051241 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:35.070182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c48bd-f1c6-4b56-b1bf-79bd49ee9013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:35.070817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c48bd-f1c6-4b56-b1bf-79bd49ee9013 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:35.071100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c48bd-f1c6-4b56-b1bf-79bd49ee9013 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:35.071364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c48bd-f1c6-4b56-b1bf-79bd49ee9013 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:35.083390 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c48bd-f1c6-4b56-b1bf-79bd49ee9013 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:35.084946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c48bd-f1c6-4b56-b1bf-79bd49ee9013 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-199c48bd-f1c6-4b56-b1bf-79bd49ee9013 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:35.107466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:35.108439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:35.109412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:35.109412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:35.109412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:35.109412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:35.109412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:35.109412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:35.109412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:35.109412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:35.110972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 340/673] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:35.116011 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c48bd-f1c6-4b56-b1bf-79bd49ee9013 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:35.197885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd7285-7401-4b71-aada-6c665a2e2c4f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:35.265634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c48bd-f1c6-4b56-b1bf-79bd49ee9013 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:35.267001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b3a3-5083-488a-ae62-ec942c98fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:35.267775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b3a3-5083-488a-ae62-ec942c98fc1f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:35.268172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b3a3-5083-488a-ae62-ec942c98fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:35.269875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b3a3-5083-488a-ae62-ec942c98fc1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:35.284097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08b3a3-5083-488a-ae62-ec942c98fc1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:35.285682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08b3a3-5083-488a-ae62-ec942c98fc1f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bc08b3a3-5083-488a-ae62-ec942c98fc1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:35.304652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:35.305557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:35.306432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:35.306432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:35.306432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:35.306432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:35.306432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:35.306432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:35.306432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:35.306432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:35.310199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 334/674] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:35.315366 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b3a3-5083-488a-ae62-ec942c98fc1f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:35.324210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:35.333366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e683201-c0cf-4dfe-ab6a-88d46edc96cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:35.334030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683201-c0cf-4dfe-ab6a-88d46edc96cf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:35.334314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683201-c0cf-4dfe-ab6a-88d46edc96cf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:35.344285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683201-c0cf-4dfe-ab6a-88d46edc96cf None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:35.344285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e683201-c0cf-4dfe-ab6a-88d46edc96cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:35.344285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e683201-c0cf-4dfe-ab6a-88d46edc96cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:35.344285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e683201-c0cf-4dfe-ab6a-88d46edc96cf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:35.360251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 341/675] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:35.361332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e683201-c0cf-4dfe-ab6a-88d46edc96cf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:35.441829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:35.451951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b3a3-5083-488a-ae62-ec942c98fc1f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:35.468266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e683201-c0cf-4dfe-ab6a-88d46edc96cf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:35.489024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab9a88-6419-4e34-82c9-4b0b2480dc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:35.489638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab9a88-6419-4e34-82c9-4b0b2480dc96 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:35.489916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab9a88-6419-4e34-82c9-4b0b2480dc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:35.490191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab9a88-6419-4e34-82c9-4b0b2480dc96 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:35.491345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab9a88-6419-4e34-82c9-4b0b2480dc96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:35.491797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab9a88-6419-4e34-82c9-4b0b2480dc96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:35.493816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab9a88-6419-4e34-82c9-4b0b2480dc96 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:35.505277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7f6f-87e4-48f6-bcad-52f067572c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:35.505997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7f6f-87e4-48f6-bcad-52f067572c7c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:35.506348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7f6f-87e4-48f6-bcad-52f067572c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:35.506714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7f6f-87e4-48f6-bcad-52f067572c7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:35.509739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 335/676] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:35.510777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab9a88-6419-4e34-82c9-4b0b2480dc96 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:35.518321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa7f6f-87e4-48f6-bcad-52f067572c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d8aa7f6f-87e4-48f6-bcad-52f067572c7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:35.523783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:35.525591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 342/677] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:35.528142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7f6f-87e4-48f6-bcad-52f067572c7c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:35.596491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:35.637295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7f6f-87e4-48f6-bcad-52f067572c7c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:35.637487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab9a88-6419-4e34-82c9-4b0b2480dc96 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:35.671952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47077d-8f94-4b16-a4ca-8db379f74aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:35.672557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47077d-8f94-4b16-a4ca-8db379f74aed None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:35.672835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47077d-8f94-4b16-a4ca-8db379f74aed None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:35.673187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47077d-8f94-4b16-a4ca-8db379f74aed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:35.673904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47077d-8f94-4b16-a4ca-8db379f74aed None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=81b6abdeca334777b597215dfe157688) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:35.674211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47077d-8f94-4b16-a4ca-8db379f74aed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:35.675634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47077d-8f94-4b16-a4ca-8db379f74aed None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:35.678622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151d6a6-e3a9-4293-821b-373641320cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:35.679225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151d6a6-e3a9-4293-821b-373641320cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:35.679501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151d6a6-e3a9-4293-821b-373641320cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:35.679778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151d6a6-e3a9-4293-821b-373641320cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:35.680538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151d6a6-e3a9-4293-821b-373641320cb7 None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=81bb83de9f794ac9b02e5dca2df3e4d1) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:35.680844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151d6a6-e3a9-4293-821b-373641320cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:35.692592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 343/678] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:35 2022] GET /identity/v3/role_assignments?user.id=81b6abdeca334777b597215dfe157688&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:35.692796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151d6a6-e3a9-4293-821b-373641320cb7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:35.692905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47077d-8f94-4b16-a4ca-8db379f74aed None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:35.708255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 336/679] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:35 2022] GET /identity/v3/role_assignments?user.id=81bb83de9f794ac9b02e5dca2df3e4d1&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:35.709960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de49186-6886-4ae0-a514-1d89f6d273ba None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:35.710252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de49186-6886-4ae0-a514-1d89f6d273ba None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:35.710535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de49186-6886-4ae0-a514-1d89f6d273ba None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:35.716793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 337/680] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:35.721545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f592275-f385-4c6a-a875-19a8dfbf774f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:35.721830 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f592275-f385-4c6a-a875-19a8dfbf774f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:35.722111 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f592275-f385-4c6a-a875-19a8dfbf774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:35.765533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7f592275-f385-4c6a-a875-19a8dfbf774f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:35.767209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7f592275-f385-4c6a-a875-19a8dfbf774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:35.791131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:35.890836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47077d-8f94-4b16-a4ca-8db379f74aed None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:35.903333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 338/681] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:35.914634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:35.941107 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902e91-cbe6-4f6b-b1db-e4428c213116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:35.941712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902e91-cbe6-4f6b-b1db-e4428c213116 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:35.941988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902e91-cbe6-4f6b-b1db-e4428c213116 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:35.942258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902e91-cbe6-4f6b-b1db-e4428c213116 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:35.942913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902e91-cbe6-4f6b-b1db-e4428c213116 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:35.943214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902e91-cbe6-4f6b-b1db-e4428c213116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:35.944759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902e91-cbe6-4f6b-b1db-e4428c213116 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:35.954490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 344/682] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:35.959860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f592275-f385-4c6a-a875-19a8dfbf774f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:36.087532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f592275-f385-4c6a-a875-19a8dfbf774f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:36.137271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04113d10-4538-4791-af3c-69cd46a0127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:36.138311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113d10-4538-4791-af3c-69cd46a0127f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:36.138786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113d10-4538-4791-af3c-69cd46a0127f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:36.139251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113d10-4538-4791-af3c-69cd46a0127f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:36.152810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04113d10-4538-4791-af3c-69cd46a0127f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:36.154563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04113d10-4538-4791-af3c-69cd46a0127f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:36.165329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-04113d10-4538-4791-af3c-69cd46a0127f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:36.173661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:36.179383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:36.180400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:36.180400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:36.180400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:36.180400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 339/683] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:36.181384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902e91-cbe6-4f6b-b1db-e4428c213116 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:36.211734 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04113d10-4538-4791-af3c-69cd46a0127f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:36.330242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902e91-cbe6-4f6b-b1db-e4428c213116 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:36.385088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580d94e-6491-45a2-b7a4-03748a8df25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:36.385691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d94e-6491-45a2-b7a4-03748a8df25c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:36.385961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d94e-6491-45a2-b7a4-03748a8df25c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:36.386260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d94e-6491-45a2-b7a4-03748a8df25c None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:36.386901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580d94e-6491-45a2-b7a4-03748a8df25c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:36.387197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580d94e-6491-45a2-b7a4-03748a8df25c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:36.388627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580d94e-6491-45a2-b7a4-03748a8df25c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:36.407980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 345/684] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:36.412524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580d94e-6491-45a2-b7a4-03748a8df25c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:36.418077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04113d10-4538-4791-af3c-69cd46a0127f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:36.472484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d1e0f-0c7e-4ab7-8f05-b889d942fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:36.473027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d1e0f-0c7e-4ab7-8f05-b889d942fa96 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:36.473301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d1e0f-0c7e-4ab7-8f05-b889d942fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:36.473566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d1e0f-0c7e-4ab7-8f05-b889d942fa96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:36.474507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:36.496684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d1e0f-0c7e-4ab7-8f05-b889d942fa96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b00d1e0f-0c7e-4ab7-8f05-b889d942fa96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:36.502027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:36.502946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:36.503759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:36.504428 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 340/685] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:36.514449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d1e0f-0c7e-4ab7-8f05-b889d942fa96 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:36.604006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580d94e-6491-45a2-b7a4-03748a8df25c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:36.613161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:36.646629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bcf32-00af-4b51-8b40-968e33f3120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:36.647788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bcf32-00af-4b51-8b40-968e33f3120c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:36.648588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bcf32-00af-4b51-8b40-968e33f3120c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:36.649060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bcf32-00af-4b51-8b40-968e33f3120c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:36.658740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bcf32-00af-4b51-8b40-968e33f3120c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:36.661170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bcf32-00af-4b51-8b40-968e33f3120c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:36.662375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d1e0f-0c7e-4ab7-8f05-b889d942fa96 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-bd2bcf32-00af-4b51-8b40-968e33f3120c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:36.676198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:36.677135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:36.678066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:36.678066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:36.678066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:36.678066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:36.678066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:36.678066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:36.678066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:36.678066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:36.678066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:36.678066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:36.680798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 346/686] 10.222.0.55 () {56 vars in 1093 bytes} [Fri Sep 2 09:13:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:36.682562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee277aa-8d69-4c1d-af0a-8dccb316a64c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:36.683039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee277aa-8d69-4c1d-af0a-8dccb316a64c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:36.683990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee277aa-8d69-4c1d-af0a-8dccb316a64c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:36.689779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 347/687] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:36.689779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee277aa-8d69-4c1d-af0a-8dccb316a64c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:36.703704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75cf45-1465-40df-b3bf-b341c7d404e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:36.704349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75cf45-1465-40df-b3bf-b341c7d404e6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:36.704627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75cf45-1465-40df-b3bf-b341c7d404e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:36.704895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75cf45-1465-40df-b3bf-b341c7d404e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:36.705541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75cf45-1465-40df-b3bf-b341c7d404e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:36.705835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75cf45-1465-40df-b3bf-b341c7d404e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:36.707362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75cf45-1465-40df-b3bf-b341c7d404e6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:36.715813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 341/688] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:36.716972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ccd33-1685-40a9-97f1-414f0f257be7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:36.717251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ccd33-1685-40a9-97f1-414f0f257be7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:36.717523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ccd33-1685-40a9-97f1-414f0f257be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:36.735320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-140ccd33-1685-40a9-97f1-414f0f257be7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:36.736459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-140ccd33-1685-40a9-97f1-414f0f257be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:36.811237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 342/689] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:36.811237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ccd33-1685-40a9-97f1-414f0f257be7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:36.823058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:36.833335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee277aa-8d69-4c1d-af0a-8dccb316a64c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:36.895530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:36.896520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6482774-e520-4c61-b695-ec6e2be32d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:36.897126 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6482774-e520-4c61-b695-ec6e2be32d7d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:36.897401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6482774-e520-4c61-b695-ec6e2be32d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:36.897661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6482774-e520-4c61-b695-ec6e2be32d7d None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:36.898387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6482774-e520-4c61-b695-ec6e2be32d7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:36.898683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6482774-e520-4c61-b695-ec6e2be32d7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:36.900126 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6482774-e520-4c61-b695-ec6e2be32d7d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:36.936851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 348/690] 10.222.0.55 () {56 vars in 1133 bytes} [Fri Sep 2 09:13:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:36.942104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6482774-e520-4c61-b695-ec6e2be32d7d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:36.981693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ccd33-1685-40a9-97f1-414f0f257be7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:37.049441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f3c2-53fe-4235-a090-75325ef39a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:37.050455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f3c2-53fe-4235-a090-75325ef39a3f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.052372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f3c2-53fe-4235-a090-75325ef39a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.052826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f3c2-53fe-4235-a090-75325ef39a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.075191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7f3c2-53fe-4235-a090-75325ef39a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:37.078524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7f3c2-53fe-4235-a090-75325ef39a3f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-12d7f3c2-53fe-4235-a090-75325ef39a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:37.109617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:37.110770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:37.111890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:37.111890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:37.111890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:37.116466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 343/691] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:37.120811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6482774-e520-4c61-b695-ec6e2be32d7d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:37.122197 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f3c2-53fe-4235-a090-75325ef39a3f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:37.184492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a86e5d-f129-4d99-bb5e-5b54308708d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:37.185368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86e5d-f129-4d99-bb5e-5b54308708d5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.185790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86e5d-f129-4d99-bb5e-5b54308708d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.186204 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86e5d-f129-4d99-bb5e-5b54308708d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.209395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:37.261928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f3c2-53fe-4235-a090-75325ef39a3f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:37.264000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:37.265254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a86e5d-f129-4d99-bb5e-5b54308708d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:37.266900 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a86e5d-f129-4d99-bb5e-5b54308708d5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:37.304592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfedcc5-a007-4c87-8309-449bfd8023a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:37.305270 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfedcc5-a007-4c87-8309-449bfd8023a4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.305662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfedcc5-a007-4c87-8309-449bfd8023a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.306149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfedcc5-a007-4c87-8309-449bfd8023a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.307347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfedcc5-a007-4c87-8309-449bfd8023a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:37.307970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfedcc5-a007-4c87-8309-449bfd8023a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:37.309495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfedcc5-a007-4c87-8309-449bfd8023a4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:37.325386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 344/692] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:37.333512 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfedcc5-a007-4c87-8309-449bfd8023a4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:37.393713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 349/693] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:37.394649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a86e5d-f129-4d99-bb5e-5b54308708d5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:37.449652 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:37.452731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfedcc5-a007-4c87-8309-449bfd8023a4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:37.492079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e29ff-bb33-480f-9235-dc5d11482a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:37.493054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e29ff-bb33-480f-9235-dc5d11482a87 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.493433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e29ff-bb33-480f-9235-dc5d11482a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.493797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e29ff-bb33-480f-9235-dc5d11482a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.505898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e29ff-bb33-480f-9235-dc5d11482a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:37.507626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e29ff-bb33-480f-9235-dc5d11482a87 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:37.512315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a86e5d-f129-4d99-bb5e-5b54308708d5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-731e29ff-bb33-480f-9235-dc5d11482a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:37.525537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:37.526673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:37.527766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:37.527766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:37.527766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:37.528714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 345/694] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:37.529547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e29ff-bb33-480f-9235-dc5d11482a87 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:37.547661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:37.562771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4c89b-a37f-4604-bd72-08f091a5bff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:37.562771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4c89b-a37f-4604-bd72-08f091a5bff9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.562771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4c89b-a37f-4604-bd72-08f091a5bff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.562771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4c89b-a37f-4604-bd72-08f091a5bff9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.569320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4c89b-a37f-4604-bd72-08f091a5bff9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:37.571543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4c89b-a37f-4604-bd72-08f091a5bff9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a8c4c89b-a37f-4604-bd72-08f091a5bff9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:37.587795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:37.588815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:37.589783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 350/695] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:37.590419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4c89b-a37f-4604-bd72-08f091a5bff9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:37.648762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e29ff-bb33-480f-9235-dc5d11482a87 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:37.685207 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c1245-d026-4bd7-abfc-fd422c4841ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:37.686245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c1245-d026-4bd7-abfc-fd422c4841ef None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.686749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c1245-d026-4bd7-abfc-fd422c4841ef None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.687264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c1245-d026-4bd7-abfc-fd422c4841ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.700127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c1245-d026-4bd7-abfc-fd422c4841ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:37.701863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c1245-d026-4bd7-abfc-fd422c4841ef None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-491c1245-d026-4bd7-abfc-fd422c4841ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:37.718060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:37.719010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:37.720558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:37.720558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:37.720558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:37.722612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 346/696] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:37.723720 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c1245-d026-4bd7-abfc-fd422c4841ef None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:37.724655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4c89b-a37f-4604-bd72-08f091a5bff9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:37.741811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:37.771150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a595d-e635-432d-94c2-f68e230f157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:37.771756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a595d-e635-432d-94c2-f68e230f157d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.772061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a595d-e635-432d-94c2-f68e230f157d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.772334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a595d-e635-432d-94c2-f68e230f157d None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.773068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a595d-e635-432d-94c2-f68e230f157d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:37.773892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a595d-e635-432d-94c2-f68e230f157d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:37.775998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a595d-e635-432d-94c2-f68e230f157d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:37.791466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 351/697] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:37.793862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a595d-e635-432d-94c2-f68e230f157d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:37.810816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:37.858220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c1245-d026-4bd7-abfc-fd422c4841ef None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:37.895851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e702b1d-a2e2-47d7-a841-94974b7b0b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:37.896846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e702b1d-a2e2-47d7-a841-94974b7b0b23 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.897447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e702b1d-a2e2-47d7-a841-94974b7b0b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.897719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e702b1d-a2e2-47d7-a841-94974b7b0b23 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.898514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e702b1d-a2e2-47d7-a841-94974b7b0b23 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:37.898817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e702b1d-a2e2-47d7-a841-94974b7b0b23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:37.900286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e702b1d-a2e2-47d7-a841-94974b7b0b23 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:37.913988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a595d-e635-432d-94c2-f68e230f157d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:37.918268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 347/698] 10.222.0.55 () {56 vars in 1135 bytes} [Fri Sep 2 09:13:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:37.919051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e702b1d-a2e2-47d7-a841-94974b7b0b23 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:37.949255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f9d13-f66e-411e-9c6f-690cb90fb49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:37.949851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f9d13-f66e-411e-9c6f-690cb90fb49d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.950125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f9d13-f66e-411e-9c6f-690cb90fb49d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.950397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f9d13-f66e-411e-9c6f-690cb90fb49d None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.951029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f9d13-f66e-411e-9c6f-690cb90fb49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:37.951326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f9d13-f66e-411e-9c6f-690cb90fb49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:37.952730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f9d13-f66e-411e-9c6f-690cb90fb49d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:37.963818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 352/699] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:37.965033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60114a-4b13-4d8c-9877-637a467b1e1e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.965310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60114a-4b13-4d8c-9877-637a467b1e1e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.965579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60114a-4b13-4d8c-9877-637a467b1e1e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.966759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 353/700] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:37.967768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934630a-eb98-4152-b56e-d3ff60a36f8e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:37.968084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934630a-eb98-4152-b56e-d3ff60a36f8e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:37.968434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934630a-eb98-4152-b56e-d3ff60a36f8e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:37.969634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 354/701] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:37.970176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934630a-eb98-4152-b56e-d3ff60a36f8e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:38.001310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:38.022158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e702b1d-a2e2-47d7-a841-94974b7b0b23 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:38.045862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:38.056079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34916e0f-c3b6-40a1-b1c0-98a79fc26433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:38.056678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34916e0f-c3b6-40a1-b1c0-98a79fc26433 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:38.056970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34916e0f-c3b6-40a1-b1c0-98a79fc26433 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:38.057218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34916e0f-c3b6-40a1-b1c0-98a79fc26433 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:38.057850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34916e0f-c3b6-40a1-b1c0-98a79fc26433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:38.059835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34916e0f-c3b6-40a1-b1c0-98a79fc26433 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:38.070014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934630a-eb98-4152-b56e-d3ff60a36f8e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:38.102049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5ca4c-af1b-4afa-a974-078eefac8a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:38.102583 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5ca4c-af1b-4afa-a974-078eefac8a25 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:38.102857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5ca4c-af1b-4afa-a974-078eefac8a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:38.103126 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5ca4c-af1b-4afa-a974-078eefac8a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:38.123414 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 348/702] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:13:37 2022] POST /identity/v3/users => generated 254 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:13:38.124263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34916e0f-c3b6-40a1-b1c0-98a79fc26433 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:38.188804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5ca4c-af1b-4afa-a974-078eefac8a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:38.190384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5ca4c-af1b-4afa-a974-078eefac8a25 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:38.224335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:38.232549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34916e0f-c3b6-40a1-b1c0-98a79fc26433 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:38.271802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d6118-060d-4439-bcba-df83ce35fd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:38.272468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6118-060d-4439-bcba-df83ce35fd7d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:38.272742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6118-060d-4439-bcba-df83ce35fd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:38.273036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6118-060d-4439-bcba-df83ce35fd7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:38.280559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d6118-060d-4439-bcba-df83ce35fd7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:38.282759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d6118-060d-4439-bcba-df83ce35fd7d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-fe4d6118-060d-4439-bcba-df83ce35fd7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:38.294744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:38.295811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:38.297119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:38.297119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:38.297119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:38.297119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:38.297119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:38.297119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:38.297119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:38.297119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:38.297119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 349/703] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:38.297119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acc2ff-8537-4c83-a378-ce5a905046d4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:38.297765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acc2ff-8537-4c83-a378-ce5a905046d4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:38.297765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acc2ff-8537-4c83-a378-ce5a905046d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:38.304813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 355/704] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:38.306370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8f0e1-a311-466d-90b9-206860748744 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:38.306652 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8f0e1-a311-466d-90b9-206860748744 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:38.306917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8f0e1-a311-466d-90b9-206860748744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:38.323265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d7acc2ff-8537-4c83-a378-ce5a905046d4 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:38.324540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d7acc2ff-8537-4c83-a378-ce5a905046d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:38.324797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bac8f0e1-a311-466d-90b9-206860748744 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:38.325962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bac8f0e1-a311-466d-90b9-206860748744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:38.363071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:38.396493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 350/705] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:38.397341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acc2ff-8537-4c83-a378-ce5a905046d4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:38.398379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 356/706] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:38.399640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8f0e1-a311-466d-90b9-206860748744 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:38.525627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:38.541859 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acc2ff-8537-4c83-a378-ce5a905046d4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:38.593481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8f0e1-a311-466d-90b9-206860748744 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:38.616075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac88a10-4caa-4ecb-a8f2-cac049677f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:38.616569 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac88a10-4caa-4ecb-a8f2-cac049677f65 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:38.616915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac88a10-4caa-4ecb-a8f2-cac049677f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:38.617196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac88a10-4caa-4ecb-a8f2-cac049677f65 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:38.618144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac88a10-4caa-4ecb-a8f2-cac049677f65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:38.618460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac88a10-4caa-4ecb-a8f2-cac049677f65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:38.619919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac88a10-4caa-4ecb-a8f2-cac049677f65 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:38.639675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 351/707] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:38.645879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac88a10-4caa-4ecb-a8f2-cac049677f65 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:38.668557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442fb8-73c0-4b73-a636-1d3065091020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:38.669528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442fb8-73c0-4b73-a636-1d3065091020 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:38.670745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442fb8-73c0-4b73-a636-1d3065091020 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:38.671231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442fb8-73c0-4b73-a636-1d3065091020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:38.691643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442fb8-73c0-4b73-a636-1d3065091020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:38.694632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442fb8-73c0-4b73-a636-1d3065091020 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:38.716228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-43442fb8-73c0-4b73-a636-1d3065091020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:38.721706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:38.722650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:38.723546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:38.723546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:38.723546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:38.728890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 357/708] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:38.730106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442fb8-73c0-4b73-a636-1d3065091020 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:38.795413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac88a10-4caa-4ecb-a8f2-cac049677f65 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:38.832768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4c1b5-ab89-4b7d-9a19-4413ee30f2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:38.833385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4c1b5-ab89-4b7d-9a19-4413ee30f2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:38.833662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4c1b5-ab89-4b7d-9a19-4413ee30f2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:38.833937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4c1b5-ab89-4b7d-9a19-4413ee30f2c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:38.834687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4c1b5-ab89-4b7d-9a19-4413ee30f2c3 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=5d74d78932554527a8bcb5880b2b9c96) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:38.834996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4c1b5-ab89-4b7d-9a19-4413ee30f2c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:38.836505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4c1b5-ab89-4b7d-9a19-4413ee30f2c3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:38.841274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442fb8-73c0-4b73-a636-1d3065091020 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:38.852258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 352/709] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:38 2022] GET /identity/v3/role_assignments?user.id=5d74d78932554527a8bcb5880b2b9c96&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=04d1bc62091440e189989e4b973a6627 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:38.852258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4c1b5-ab89-4b7d-9a19-4413ee30f2c3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:38.857566 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:38.880356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a08f-8113-48cf-adf2-6f9f21fcd084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:38.880917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a08f-8113-48cf-adf2-6f9f21fcd084 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:38.881284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a08f-8113-48cf-adf2-6f9f21fcd084 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:38.881893 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a08f-8113-48cf-adf2-6f9f21fcd084 None admin] PATH_INFO: `/v3/services/network` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:38.882197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81a08f-8113-48cf-adf2-6f9f21fcd084 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:38.883588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81a08f-8113-48cf-adf2-6f9f21fcd084 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ab81a08f-8113-48cf-adf2-6f9f21fcd084 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:38.896301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:38.897369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:38.898207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 358/710] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:38 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:38.898988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a08f-8113-48cf-adf2-6f9f21fcd084 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:38.981090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:38.990396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4c1b5-ab89-4b7d-9a19-4413ee30f2c3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:39.009158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a08f-8113-48cf-adf2-6f9f21fcd084 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:39.040793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428d5f9-be8b-4343-b800-8fee65100046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:39.041634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428d5f9-be8b-4343-b800-8fee65100046 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:39.042040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428d5f9-be8b-4343-b800-8fee65100046 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:39.042389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428d5f9-be8b-4343-b800-8fee65100046 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:39.043504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428d5f9-be8b-4343-b800-8fee65100046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:39.043997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428d5f9-be8b-4343-b800-8fee65100046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:39.045373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428d5f9-be8b-4343-b800-8fee65100046 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:39.053284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da0c79-4fad-4d1b-bdc9-ba9006aed0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:39.054584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0c79-4fad-4d1b-bdc9-ba9006aed0ac None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:39.055338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0c79-4fad-4d1b-bdc9-ba9006aed0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:39.055918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0c79-4fad-4d1b-bdc9-ba9006aed0ac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:39.056728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da0c79-4fad-4d1b-bdc9-ba9006aed0ac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:39.059252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da0c79-4fad-4d1b-bdc9-ba9006aed0ac None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:39.059637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 353/711] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:39.064924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428d5f9-be8b-4343-b800-8fee65100046 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-28da0c79-4fad-4d1b-bdc9-ba9006aed0ac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:39.070889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:39.072148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:39.073216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 359/712] 10.222.0.55 () {56 vars in 1129 bytes} [Fri Sep 2 09:13:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:39.074662 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da0c79-4fad-4d1b-bdc9-ba9006aed0ac None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:39.129346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:39.180827 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428d5f9-be8b-4343-b800-8fee65100046 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:39.209175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da0c79-4fad-4d1b-bdc9-ba9006aed0ac None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:39.222114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f02b0-b0d1-4663-a8fa-3d453ed8a4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:39.223172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f02b0-b0d1-4663-a8fa-3d453ed8a4dd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:39.224051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f02b0-b0d1-4663-a8fa-3d453ed8a4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:39.224625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f02b0-b0d1-4663-a8fa-3d453ed8a4dd None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:39.225507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f02b0-b0d1-4663-a8fa-3d453ed8a4dd None admin] RBAC: Adding query filter params (name=network) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:39.225959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f02b0-b0d1-4663-a8fa-3d453ed8a4dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:39.228109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f02b0-b0d1-4663-a8fa-3d453ed8a4dd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:39.239125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 354/713] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:13:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:39.239125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f02b0-b0d1-4663-a8fa-3d453ed8a4dd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:39.256987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec22d2-cc3b-4749-a15a-742120a98ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:39.257874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec22d2-cc3b-4749-a15a-742120a98ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:39.258298 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec22d2-cc3b-4749-a15a-742120a98ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:39.258741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec22d2-cc3b-4749-a15a-742120a98ab4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:39.264975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:39.270266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec22d2-cc3b-4749-a15a-742120a98ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:39.272780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec22d2-cc3b-4749-a15a-742120a98ab4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-92ec22d2-cc3b-4749-a15a-742120a98ab4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:39.288681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:39.289854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:39.290922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:39.290922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:39.290922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:39.290922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:39.290922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:39.290922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:39.290922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:39.290922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:39.298657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 360/714] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:39.298657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec22d2-cc3b-4749-a15a-742120a98ab4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:39.376369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f02b0-b0d1-4663-a8fa-3d453ed8a4dd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:39.412908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a16f5-8408-45d7-8d41-955fdde71b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:39.413539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a16f5-8408-45d7-8d41-955fdde71b0b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:39.413790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a16f5-8408-45d7-8d41-955fdde71b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:39.414062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a16f5-8408-45d7-8d41-955fdde71b0b None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:39.414684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a16f5-8408-45d7-8d41-955fdde71b0b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:39.414985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a16f5-8408-45d7-8d41-955fdde71b0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:39.416406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a16f5-8408-45d7-8d41-955fdde71b0b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:39.425888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 355/715] 10.222.0.55 () {56 vars in 1124 bytes} [Fri Sep 2 09:13:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:39.425888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a16f5-8408-45d7-8d41-955fdde71b0b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:39.462240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec22d2-cc3b-4749-a15a-742120a98ab4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:39.464740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:39.501554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666d7ca-78e3-4354-a375-b793c3bb1299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:39.502161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666d7ca-78e3-4354-a375-b793c3bb1299 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:39.502440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666d7ca-78e3-4354-a375-b793c3bb1299 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:39.502755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666d7ca-78e3-4354-a375-b793c3bb1299 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:39.503384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666d7ca-78e3-4354-a375-b793c3bb1299 None admin] RBAC: Adding query filter params (type=network) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:39.503687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666d7ca-78e3-4354-a375-b793c3bb1299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:39.505474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666d7ca-78e3-4354-a375-b793c3bb1299 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:39.519939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 361/716] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:13:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:39.519939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666d7ca-78e3-4354-a375-b793c3bb1299 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:39.547368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:39.587181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a16f5-8408-45d7-8d41-955fdde71b0b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:39.659078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c970b-c56f-4f2b-947b-9c849fb72256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:39.660185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c970b-c56f-4f2b-947b-9c849fb72256 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:39.660742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c970b-c56f-4f2b-947b-9c849fb72256 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:39.661233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c970b-c56f-4f2b-947b-9c849fb72256 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:39.662180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c970b-c56f-4f2b-947b-9c849fb72256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:39.663553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c970b-c56f-4f2b-947b-9c849fb72256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:39.667110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c970b-c56f-4f2b-947b-9c849fb72256 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:39.691565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 356/717] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:39.697852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c970b-c56f-4f2b-947b-9c849fb72256 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:39.710317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666d7ca-78e3-4354-a375-b793c3bb1299 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:39.751681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62f560-291a-40e1-8e36-14dfd0994823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:39.752296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f560-291a-40e1-8e36-14dfd0994823 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:39.752575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f560-291a-40e1-8e36-14dfd0994823 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:39.752838 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f560-291a-40e1-8e36-14dfd0994823 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:39.753462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62f560-291a-40e1-8e36-14dfd0994823 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:39.753755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62f560-291a-40e1-8e36-14dfd0994823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:39.755239 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62f560-291a-40e1-8e36-14dfd0994823 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:39.760352 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 362/718] 10.222.0.55 () {56 vars in 1124 bytes} [Fri Sep 2 09:13:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:39.827693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c970b-c56f-4f2b-947b-9c849fb72256 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:39.868457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc23a3-48e0-4ad5-9b80-2b5c2a03bbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:39.869392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc23a3-48e0-4ad5-9b80-2b5c2a03bbed None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:39.869798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc23a3-48e0-4ad5-9b80-2b5c2a03bbed None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:39.870177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc23a3-48e0-4ad5-9b80-2b5c2a03bbed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:39.871067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc23a3-48e0-4ad5-9b80-2b5c2a03bbed None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=01367d6c12014bc0bc9410b4a5a98693) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:39.871477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc23a3-48e0-4ad5-9b80-2b5c2a03bbed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:39.873084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc23a3-48e0-4ad5-9b80-2b5c2a03bbed None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:39.884001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 357/719] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:39 2022] GET /identity/v3/role_assignments?user.id=01367d6c12014bc0bc9410b4a5a98693&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:40.226493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657c937-bcd2-460d-a12a-db9b47dfaafa None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:40.227065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657c937-bcd2-460d-a12a-db9b47dfaafa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:40.227340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657c937-bcd2-460d-a12a-db9b47dfaafa None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:40.228905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 363/720] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:40.234468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935b94-cfbc-481d-b783-53bbaea6fcf5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:40.234753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935b94-cfbc-481d-b783-53bbaea6fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:40.235062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935b94-cfbc-481d-b783-53bbaea6fcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:40.252433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:40.258306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-0e935b94-cfbc-481d-b783-53bbaea6fcf5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:40.259510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0e935b94-cfbc-481d-b783-53bbaea6fcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:40.333159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 358/721] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:40.613252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657c937-bcd2-460d-a12a-db9b47dfaafa None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:40.645606 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:40.732574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657c937-bcd2-460d-a12a-db9b47dfaafa None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:40.777445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4315fba-bf64-4b4f-80e3-48832e7b6928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:40.778078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4315fba-bf64-4b4f-80e3-48832e7b6928 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:40.778356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4315fba-bf64-4b4f-80e3-48832e7b6928 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:40.778626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4315fba-bf64-4b4f-80e3-48832e7b6928 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:40.795564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4315fba-bf64-4b4f-80e3-48832e7b6928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a4315fba-bf64-4b4f-80e3-48832e7b6928 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:40.800983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:40.801930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:40.802775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 364/722] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:40.808943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e935b94-cfbc-481d-b783-53bbaea6fcf5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:40.919618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e935b94-cfbc-481d-b783-53bbaea6fcf5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:40.960720 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e25b2-a6b7-4d76-85f2-e073e643eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:40.961340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e25b2-a6b7-4d76-85f2-e073e643eca1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:40.961617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e25b2-a6b7-4d76-85f2-e073e643eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:40.961888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e25b2-a6b7-4d76-85f2-e073e643eca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:40.962553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e25b2-a6b7-4d76-85f2-e073e643eca1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:40.962851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e25b2-a6b7-4d76-85f2-e073e643eca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:40.964245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e25b2-a6b7-4d76-85f2-e073e643eca1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:40.969043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:40.976186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 359/723] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:40.982277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4315fba-bf64-4b4f-80e3-48832e7b6928 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:41.015970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e6049-aeb1-4a89-b41b-9f5804b61482 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:41.016305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e6049-aeb1-4a89-b41b-9f5804b61482 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:41.016531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e6049-aeb1-4a89-b41b-9f5804b61482 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:41.018173 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 360/724] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:13:41.023639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da09fb-9025-47e4-b089-9ac5318e8a25 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:41.023957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da09fb-9025-47e4-b089-9ac5318e8a25 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:41.024242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da09fb-9025-47e4-b089-9ac5318e8a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:41.044606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-51da09fb-9025-47e4-b089-9ac5318e8a25 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:41.046186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-51da09fb-9025-47e4-b089-9ac5318e8a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:41.103324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:41.114757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4315fba-bf64-4b4f-80e3-48832e7b6928 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:41.143705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 361/725] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 09:13:41.168534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfb046-fc56-41a6-81e3-0c964aa5f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:41.169496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfb046-fc56-41a6-81e3-0c964aa5f5ab None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:41.170026 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfb046-fc56-41a6-81e3-0c964aa5f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:41.170523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfb046-fc56-41a6-81e3-0c964aa5f5ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:41.190089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfb046-fc56-41a6-81e3-0c964aa5f5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:41.191855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfb046-fc56-41a6-81e3-0c964aa5f5ab None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ffbfb046-fc56-41a6-81e3-0c964aa5f5ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:41.207212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:41.208228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:41.209134 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:41.209134 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:41.209134 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:41.211316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 365/726] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:41.221003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da09fb-9025-47e4-b089-9ac5318e8a25 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:41.332923 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da09fb-9025-47e4-b089-9ac5318e8a25 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:41.362444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:41.371358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37295df4-17a3-4394-8f3f-117029f19602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:41.372010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37295df4-17a3-4394-8f3f-117029f19602 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:41.372274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37295df4-17a3-4394-8f3f-117029f19602 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:41.372554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37295df4-17a3-4394-8f3f-117029f19602 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:41.373197 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37295df4-17a3-4394-8f3f-117029f19602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:41.373551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37295df4-17a3-4394-8f3f-117029f19602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:41.374923 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37295df4-17a3-4394-8f3f-117029f19602 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:41.386784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 362/727] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:41.391977 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfb046-fc56-41a6-81e3-0c964aa5f5ab None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:41.556852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37295df4-17a3-4394-8f3f-117029f19602 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:41.561877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfb046-fc56-41a6-81e3-0c964aa5f5ab None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:41.624069 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa3cb1-0778-4865-9aec-31569b2f47a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:41.626059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa3cb1-0778-4865-9aec-31569b2f47a1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:41.626568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa3cb1-0778-4865-9aec-31569b2f47a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:41.627228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa3cb1-0778-4865-9aec-31569b2f47a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:41.637711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa3cb1-0778-4865-9aec-31569b2f47a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:41.639473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa3cb1-0778-4865-9aec-31569b2f47a1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-07aa3cb1-0778-4865-9aec-31569b2f47a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:41.652232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:41.653279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:41.654277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:41.654277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:41.654277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:41.654277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:41.654277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:41.654277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:41.654277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:41.654277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:41.654277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:13:41.654277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:41.656867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 366/728] 10.222.0.55 () {56 vars in 1117 bytes} [Fri Sep 2 09:13:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:41.666372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa3cb1-0778-4865-9aec-31569b2f47a1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:41.672907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:41.693634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37295df4-17a3-4394-8f3f-117029f19602 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:41.750369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814be29-f372-442e-8740-47840d98e351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:41.751014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814be29-f372-442e-8740-47840d98e351 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:41.751288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814be29-f372-442e-8740-47840d98e351 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:41.751721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814be29-f372-442e-8740-47840d98e351 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:41.773231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814be29-f372-442e-8740-47840d98e351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-4814be29-f372-442e-8740-47840d98e351 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:41.778507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:41.779442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:41.780337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 363/729] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:41.787548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814be29-f372-442e-8740-47840d98e351 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:41.791085 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa3cb1-0778-4865-9aec-31569b2f47a1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:41.830638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cf898-ab38-4762-936d-ac7a0a038484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:41.831637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cf898-ab38-4762-936d-ac7a0a038484 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:41.832143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cf898-ab38-4762-936d-ac7a0a038484 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:41.832655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cf898-ab38-4762-936d-ac7a0a038484 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:41.833596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cf898-ab38-4762-936d-ac7a0a038484 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:41.834130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cf898-ab38-4762-936d-ac7a0a038484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:41.835787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cf898-ab38-4762-936d-ac7a0a038484 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:41.856422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 367/730] 10.222.0.55 () {56 vars in 1149 bytes} [Fri Sep 2 09:13:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:41.864868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cf898-ab38-4762-936d-ac7a0a038484 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:41.884311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:41.941654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814be29-f372-442e-8740-47840d98e351 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:41.975609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007892b3-3778-462b-9483-9752788dca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:41.976243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007892b3-3778-462b-9483-9752788dca5f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:41.976517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007892b3-3778-462b-9483-9752788dca5f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:41.976784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007892b3-3778-462b-9483-9752788dca5f None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:41.977440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007892b3-3778-462b-9483-9752788dca5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:41.977736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007892b3-3778-462b-9483-9752788dca5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:41.979101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007892b3-3778-462b-9483-9752788dca5f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:41.988314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 364/731] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:41.989494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591d27-4964-4a6b-a14a-d91f2054db96 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:41.989768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591d27-4964-4a6b-a14a-d91f2054db96 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:41.990035 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591d27-4964-4a6b-a14a-d91f2054db96 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:41.990242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:41.991422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 365/732] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:41.997514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df541be7-a72e-4e82-bd0d-595e3b3ed709 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:41.998802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df541be7-a72e-4e82-bd0d-595e3b3ed709 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:41.998802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df541be7-a72e-4e82-bd0d-595e3b3ed709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.019737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-df541be7-a72e-4e82-bd0d-595e3b3ed709 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:42.021193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-df541be7-a72e-4e82-bd0d-595e3b3ed709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:42.044445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cf898-ab38-4762-936d-ac7a0a038484 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:42.086780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43ef5b-1bcd-4c99-98d2-ee7be9377adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:42.087433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ef5b-1bcd-4c99-98d2-ee7be9377adc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.087807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ef5b-1bcd-4c99-98d2-ee7be9377adc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.088168 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ef5b-1bcd-4c99-98d2-ee7be9377adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.107999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 366/733] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:42.108945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df541be7-a72e-4e82-bd0d-595e3b3ed709 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:42.158186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:42.206584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43ef5b-1bcd-4c99-98d2-ee7be9377adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:42.208886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43ef5b-1bcd-4c99-98d2-ee7be9377adc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:42.217279 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df541be7-a72e-4e82-bd0d-595e3b3ed709 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:42.257804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fdc05-ecd7-4e03-81b0-405f2ea77c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:42.258585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fdc05-ecd7-4e03-81b0-405f2ea77c60 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.259031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fdc05-ecd7-4e03-81b0-405f2ea77c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.259412 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fdc05-ecd7-4e03-81b0-405f2ea77c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.270684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fdc05-ecd7-4e03-81b0-405f2ea77c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:42.272325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fdc05-ecd7-4e03-81b0-405f2ea77c60 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6d9fdc05-ecd7-4e03-81b0-405f2ea77c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:42.289562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:42.291302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:42.292545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:42.292545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:42.292545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:42.293954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:42.298464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 367/734] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:42.299900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eaa6f-3b52-4d79-a2e8-2b1c03181491 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.300300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eaa6f-3b52-4d79-a2e8-2b1c03181491 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.300681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eaa6f-3b52-4d79-a2e8-2b1c03181491 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.306177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 368/735] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:42.306177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eaa6f-3b52-4d79-a2e8-2b1c03181491 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:42.361623 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 368/736] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:42.362982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7597bfa-f96f-4cab-8d91-93f07495fe67 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.363368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7597bfa-f96f-4cab-8d91-93f07495fe67 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.363745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7597bfa-f96f-4cab-8d91-93f07495fe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.414174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a7597bfa-f96f-4cab-8d91-93f07495fe67 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:42.415758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a7597bfa-f96f-4cab-8d91-93f07495fe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:42.429675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:42.442569 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eaa6f-3b52-4d79-a2e8-2b1c03181491 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:42.487128 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7157030-5d6c-4b71-9988-54b0a449541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:42.487733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157030-5d6c-4b71-9988-54b0a449541f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.488044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157030-5d6c-4b71-9988-54b0a449541f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.488315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157030-5d6c-4b71-9988-54b0a449541f None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.496141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 369/737] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:42.496282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7157030-5d6c-4b71-9988-54b0a449541f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:42.496282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7157030-5d6c-4b71-9988-54b0a449541f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:42.496428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7597bfa-f96f-4cab-8d91-93f07495fe67 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:42.496509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7157030-5d6c-4b71-9988-54b0a449541f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:42.504812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 369/738] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:42.505638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7157030-5d6c-4b71-9988-54b0a449541f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:42.596463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:42.606869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7597bfa-f96f-4cab-8d91-93f07495fe67 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:42.609518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7157030-5d6c-4b71-9988-54b0a449541f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:42.643837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a7ae6-5c67-4797-bbfd-d4e9e92a8829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:42.644506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a7ae6-5c67-4797-bbfd-d4e9e92a8829 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.644788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a7ae6-5c67-4797-bbfd-d4e9e92a8829 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.645059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a7ae6-5c67-4797-bbfd-d4e9e92a8829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.646427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7063ac5-ffb3-4733-857f-3a88807c457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:42.647120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7063ac5-ffb3-4733-857f-3a88807c457f None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.647459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7063ac5-ffb3-4733-857f-3a88807c457f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.647794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7063ac5-ffb3-4733-857f-3a88807c457f None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.648595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7063ac5-ffb3-4733-857f-3a88807c457f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:42.650029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7063ac5-ffb3-4733-857f-3a88807c457f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:42.657554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a7ae6-5c67-4797-bbfd-d4e9e92a8829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:42.659029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a7ae6-5c67-4797-bbfd-d4e9e92a8829 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-606a7ae6-5c67-4797-bbfd-d4e9e92a8829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:42.674575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:42.675600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:42.676526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:42.676526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:42.676526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:42.676526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 370/739] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:42.677249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a7ae6-5c67-4797-bbfd-d4e9e92a8829 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:42.736370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 370/740] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:13:42 2022] POST /identity/v3/services => generated 240 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:13:42.737684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a59b22-d231-4a10-b0a1-2ac0c3ab37ca None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.737975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a59b22-d231-4a10-b0a1-2ac0c3ab37ca None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.738250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a59b22-d231-4a10-b0a1-2ac0c3ab37ca None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.739539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 371/741] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:42.745005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a59b22-d231-4a10-b0a1-2ac0c3ab37ca None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:42.771871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:42.791849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a7ae6-5c67-4797-bbfd-d4e9e92a8829 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:42.851566 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d3c23-28e4-42bc-b58c-6a2b86faa790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:42.852241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d3c23-28e4-42bc-b58c-6a2b86faa790 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.852519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d3c23-28e4-42bc-b58c-6a2b86faa790 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.853049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d3c23-28e4-42bc-b58c-6a2b86faa790 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.861426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d3c23-28e4-42bc-b58c-6a2b86faa790 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:42.862930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d3c23-28e4-42bc-b58c-6a2b86faa790 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:42.865694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e82d3c23-28e4-42bc-b58c-6a2b86faa790 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:42.876830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:42.881161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 371/742] 10.222.0.55 () {56 vars in 1093 bytes} [Fri Sep 2 09:13:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4ef3c-3f51-4b81-a316-4dbb233753e9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.882097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4ef3c-3f51-4b81-a316-4dbb233753e9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.883178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4ef3c-3f51-4b81-a316-4dbb233753e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.883371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a59b22-d231-4a10-b0a1-2ac0c3ab37ca None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:42.905244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a1c4ef3c-3f51-4b81-a316-4dbb233753e9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:42.907410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a1c4ef3c-3f51-4b81-a316-4dbb233753e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:42.924331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391382d1-2721-462f-a08d-1f1fc426b858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:42.925098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391382d1-2721-462f-a08d-1f1fc426b858 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:42.925449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391382d1-2721-462f-a08d-1f1fc426b858 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:42.925783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391382d1-2721-462f-a08d-1f1fc426b858 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:42.926489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391382d1-2721-462f-a08d-1f1fc426b858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:42.926857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391382d1-2721-462f-a08d-1f1fc426b858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:42.928373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391382d1-2721-462f-a08d-1f1fc426b858 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:42.941467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 372/743] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:42.942442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391382d1-2721-462f-a08d-1f1fc426b858 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:42.982915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 372/744] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:42 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:42.984050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4ef3c-3f51-4b81-a316-4dbb233753e9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:43.021899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:43.051709 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391382d1-2721-462f-a08d-1f1fc426b858 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:43.094318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09264019-2f92-4ed6-92de-8578d3b63722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:43.094957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09264019-2f92-4ed6-92de-8578d3b63722 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:43.095384 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09264019-2f92-4ed6-92de-8578d3b63722 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:43.095704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09264019-2f92-4ed6-92de-8578d3b63722 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:43.096685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09264019-2f92-4ed6-92de-8578d3b63722 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:43.098074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09264019-2f92-4ed6-92de-8578d3b63722 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:43.112594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4ef3c-3f51-4b81-a316-4dbb233753e9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:43.140889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:43.149153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9958f4-2f24-46f3-a80b-d8c634742cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:43.149831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9958f4-2f24-46f3-a80b-d8c634742cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:43.150176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9958f4-2f24-46f3-a80b-d8c634742cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:43.150524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9958f4-2f24-46f3-a80b-d8c634742cc8 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:43.151299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9958f4-2f24-46f3-a80b-d8c634742cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:43.151671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9958f4-2f24-46f3-a80b-d8c634742cc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:43.153218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9958f4-2f24-46f3-a80b-d8c634742cc8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:43.173329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 373/745] 10.222.0.55 () {56 vars in 1133 bytes} [Fri Sep 2 09:13:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:43.174682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9958f4-2f24-46f3-a80b-d8c634742cc8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:43.182737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 373/746] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:13:42 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:13:43.182737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09264019-2f92-4ed6-92de-8578d3b63722 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:43.334801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9958f4-2f24-46f3-a80b-d8c634742cc8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:43.343577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09264019-2f92-4ed6-92de-8578d3b63722 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:43.379316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:43.390269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd64d76-2d5d-4f74-b1c2-be393e3b9b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:43.391128 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd64d76-2d5d-4f74-b1c2-be393e3b9b56 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:43.391504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd64d76-2d5d-4f74-b1c2-be393e3b9b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:43.391875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd64d76-2d5d-4f74-b1c2-be393e3b9b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:43.404383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd64d76-2d5d-4f74-b1c2-be393e3b9b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:43.406138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd64d76-2d5d-4f74-b1c2-be393e3b9b56 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ebd64d76-2d5d-4f74-b1c2-be393e3b9b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:43.423089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:43.424446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:43.425545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:43.425545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:43.425545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:43.426802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 374/747] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:43.427583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd64d76-2d5d-4f74-b1c2-be393e3b9b56 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:43.494027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02bc42-a2a8-4fd9-888e-a69d5216893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:43.494819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02bc42-a2a8-4fd9-888e-a69d5216893a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:43.495320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02bc42-a2a8-4fd9-888e-a69d5216893a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:43.496631 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02bc42-a2a8-4fd9-888e-a69d5216893a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:43.505530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02bc42-a2a8-4fd9-888e-a69d5216893a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:43.506966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02bc42-a2a8-4fd9-888e-a69d5216893a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-5b02bc42-a2a8-4fd9-888e-a69d5216893a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:43.519398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:43.520498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:43.521657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:43.521657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:43.521657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:43.521657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:43.521657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:43.521657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:43.521657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:43.521657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:43.521657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 374/748] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:43.521657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02bc42-a2a8-4fd9-888e-a69d5216893a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:43.554963 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd64d76-2d5d-4f74-b1c2-be393e3b9b56 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:43.572660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:43.600931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf777c3b-edf4-4da6-8881-c4b7c7556012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:43.601793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777c3b-edf4-4da6-8881-c4b7c7556012 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:43.602632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777c3b-edf4-4da6-8881-c4b7c7556012 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:43.603135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777c3b-edf4-4da6-8881-c4b7c7556012 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:43.619294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf777c3b-edf4-4da6-8881-c4b7c7556012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bf777c3b-edf4-4da6-8881-c4b7c7556012 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:43.627200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:43.628339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:43.629347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:43.632303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 375/749] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:43.633239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf777c3b-edf4-4da6-8881-c4b7c7556012 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:43.633430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02bc42-a2a8-4fd9-888e-a69d5216893a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:43.676555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653892d8-44f7-4660-a038-69a81f4294a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:43.677079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653892d8-44f7-4660-a038-69a81f4294a1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:43.677355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653892d8-44f7-4660-a038-69a81f4294a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:43.677625 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653892d8-44f7-4660-a038-69a81f4294a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:43.678261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653892d8-44f7-4660-a038-69a81f4294a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:43.678559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653892d8-44f7-4660-a038-69a81f4294a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:43.679930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653892d8-44f7-4660-a038-69a81f4294a1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:43.694360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:43.697079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 375/750] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:43.697751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653892d8-44f7-4660-a038-69a81f4294a1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:43.768445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf777c3b-edf4-4da6-8881-c4b7c7556012 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:43.804283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653892d8-44f7-4660-a038-69a81f4294a1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:43.808017 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbc041-0a73-4dad-bb45-3a6f1cf70ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:43.808946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbc041-0a73-4dad-bb45-3a6f1cf70ded None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:43.809423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbc041-0a73-4dad-bb45-3a6f1cf70ded None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:43.809925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbc041-0a73-4dad-bb45-3a6f1cf70ded None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:43.810820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbc041-0a73-4dad-bb45-3a6f1cf70ded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:43.811330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbc041-0a73-4dad-bb45-3a6f1cf70ded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:43.812576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:43.814271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbc041-0a73-4dad-bb45-3a6f1cf70ded None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:43.833696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 376/751] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:43.841346 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbc041-0a73-4dad-bb45-3a6f1cf70ded None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:43.841546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a47e0c-7677-4774-9bd6-e0a71fa9cab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:43.842290 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a47e0c-7677-4774-9bd6-e0a71fa9cab9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:43.842654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a47e0c-7677-4774-9bd6-e0a71fa9cab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:43.843001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a47e0c-7677-4774-9bd6-e0a71fa9cab9 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:43.843732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a47e0c-7677-4774-9bd6-e0a71fa9cab9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:43.844143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a47e0c-7677-4774-9bd6-e0a71fa9cab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:43.845593 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a47e0c-7677-4774-9bd6-e0a71fa9cab9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:43.859435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 376/752] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:43.860438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a47e0c-7677-4774-9bd6-e0a71fa9cab9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:43.954041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:43.958341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbc041-0a73-4dad-bb45-3a6f1cf70ded None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:43.965742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a47e0c-7677-4774-9bd6-e0a71fa9cab9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:43.996685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be2b55-374f-49ed-80ab-2ea91004a6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:43.997894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be2b55-374f-49ed-80ab-2ea91004a6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:43.998382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be2b55-374f-49ed-80ab-2ea91004a6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:43.998909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be2b55-374f-49ed-80ab-2ea91004a6a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:44.000755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f67d90-1443-47e7-98ec-b9627ddc0f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:44.001460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67d90-1443-47e7-98ec-b9627ddc0f29 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:44.001843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67d90-1443-47e7-98ec-b9627ddc0f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:44.002231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67d90-1443-47e7-98ec-b9627ddc0f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:44.003045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f67d90-1443-47e7-98ec-b9627ddc0f29 None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=2195f7f3cd1d4f35826282958378c754) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:44.003455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f67d90-1443-47e7-98ec-b9627ddc0f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:44.005029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f67d90-1443-47e7-98ec-b9627ddc0f29 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:44.007523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be2b55-374f-49ed-80ab-2ea91004a6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:44.009230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be2b55-374f-49ed-80ab-2ea91004a6a8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:44.011191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 377/753] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:43 2022] GET /identity/v3/role_assignments?user.id=2195f7f3cd1d4f35826282958378c754&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:44.012792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f67d90-1443-47e7-98ec-b9627ddc0f29 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f5be2b55-374f-49ed-80ab-2ea91004a6a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:44.022771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:44.023768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:44.024695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:44.024695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:44.024695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:44.024695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:44.024695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:44.024695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:44.024695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:44.024695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:44.027775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 377/754] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:44.037005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be2b55-374f-49ed-80ab-2ea91004a6a8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:44.067124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:44.191133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f67d90-1443-47e7-98ec-b9627ddc0f29 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:44.238688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5097-7c06-425e-9cbd-f07347987251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:44.239553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5097-7c06-425e-9cbd-f07347987251 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:44.240028 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5097-7c06-425e-9cbd-f07347987251 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:44.240440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5097-7c06-425e-9cbd-f07347987251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:44.252563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d5097-7c06-425e-9cbd-f07347987251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:44.254769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d5097-7c06-425e-9cbd-f07347987251 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:44.255722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be2b55-374f-49ed-80ab-2ea91004a6a8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1c4d5097-7c06-425e-9cbd-f07347987251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:44.272043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:44.273238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:44.274355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:44.274355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:44.274355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:44.276559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 378/755] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:44.283153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5097-7c06-425e-9cbd-f07347987251 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:44.321381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d519b74-e65c-474b-9a8d-73b87d2ebb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:44.322294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d519b74-e65c-474b-9a8d-73b87d2ebb74 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:44.322716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d519b74-e65c-474b-9a8d-73b87d2ebb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:44.323129 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d519b74-e65c-474b-9a8d-73b87d2ebb74 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:44.324057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d519b74-e65c-474b-9a8d-73b87d2ebb74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:44.324531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d519b74-e65c-474b-9a8d-73b87d2ebb74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:44.326125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d519b74-e65c-474b-9a8d-73b87d2ebb74 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:44.339281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 378/756] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:44.345179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d519b74-e65c-474b-9a8d-73b87d2ebb74 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:44.371616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:44.461994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d519b74-e65c-474b-9a8d-73b87d2ebb74 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:44.501799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252ea5b-61ad-4767-b5e1-f2543be928d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:44.502700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ea5b-61ad-4767-b5e1-f2543be928d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:44.503131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ea5b-61ad-4767-b5e1-f2543be928d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:44.503542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ea5b-61ad-4767-b5e1-f2543be928d1 None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/5d74d78932554527a8bcb5880b2b9c96/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:44.506313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252ea5b-61ad-4767-b5e1-f2543be928d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=5d74d78932554527a8bcb5880b2b9c96, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:44.508301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252ea5b-61ad-4767-b5e1-f2543be928d1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:44.519692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:44.537421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5097-7c06-425e-9cbd-f07347987251 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:44.580534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60d1c3-df2a-4cb2-90c7-eb10fbc7e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:44.581325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60d1c3-df2a-4cb2-90c7-eb10fbc7e921 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:44.581714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60d1c3-df2a-4cb2-90c7-eb10fbc7e921 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:44.582116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60d1c3-df2a-4cb2-90c7-eb10fbc7e921 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:44.582944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60d1c3-df2a-4cb2-90c7-eb10fbc7e921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:44.583368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60d1c3-df2a-4cb2-90c7-eb10fbc7e921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:44.585031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60d1c3-df2a-4cb2-90c7-eb10fbc7e921 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:44.599086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 379/757] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:44.606335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60d1c3-df2a-4cb2-90c7-eb10fbc7e921 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:44.617530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 379/758] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:13:44 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/5d74d78932554527a8bcb5880b2b9c96/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:13:44.720287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60d1c3-df2a-4cb2-90c7-eb10fbc7e921 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:44.757627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ca32e-c25c-491a-b4f5-a67382390613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:44.758188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ca32e-c25c-491a-b4f5-a67382390613 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:44.758470 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ca32e-c25c-491a-b4f5-a67382390613 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:44.758742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ca32e-c25c-491a-b4f5-a67382390613 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:44.767854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ca32e-c25c-491a-b4f5-a67382390613 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:44.769345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ca32e-c25c-491a-b4f5-a67382390613 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-143ca32e-c25c-491a-b4f5-a67382390613 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:44.782795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:44.783780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:44.784750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 380/759] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:44.790083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252ea5b-61ad-4767-b5e1-f2543be928d1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:44.797216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e933-ebf2-4d42-8ccc-b682b8c04e01 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:44.797506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e933-ebf2-4d42-8ccc-b682b8c04e01 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:44.797770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e933-ebf2-4d42-8ccc-b682b8c04e01 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:44.799508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 381/760] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:44.813502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a73a-6a21-4357-9572-104256a82a9e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:44.814115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a73a-6a21-4357-9572-104256a82a9e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:44.814115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a73a-6a21-4357-9572-104256a82a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:44.832261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:44.837862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6c57a73a-6a21-4357-9572-104256a82a9e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:44.837862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6c57a73a-6a21-4357-9572-104256a82a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:44.926429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 382/761] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:13:44.948326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:44.957156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252ea5b-61ad-4767-b5e1-f2543be928d1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:44.998383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2dc47-89f9-4e02-a00c-7f2be55f9760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:44.999055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2dc47-89f9-4e02-a00c-7f2be55f9760 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:44.999358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2dc47-89f9-4e02-a00c-7f2be55f9760 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:44.999683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2dc47-89f9-4e02-a00c-7f2be55f9760 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:45.000448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2dc47-89f9-4e02-a00c-7f2be55f9760 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:45.000805 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2dc47-89f9-4e02-a00c-7f2be55f9760 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:45.002280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2dc47-89f9-4e02-a00c-7f2be55f9760 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:45.025308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 380/762] 10.222.0.55 () {56 vars in 1135 bytes} [Fri Sep 2 09:13:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:45.031167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a73a-6a21-4357-9572-104256a82a9e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:45.182002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a73a-6a21-4357-9572-104256a82a9e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:45.210272 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2dc47-89f9-4e02-a00c-7f2be55f9760 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:45.248171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d0b5b-e058-4c90-9b30-6a9dbb2e953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:45.248786 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d0b5b-e058-4c90-9b30-6a9dbb2e953c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:45.249059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d0b5b-e058-4c90-9b30-6a9dbb2e953c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:45.249323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d0b5b-e058-4c90-9b30-6a9dbb2e953c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:45.253968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:45.369520 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2dc47-89f9-4e02-a00c-7f2be55f9760 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:45.407562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f8a6-75de-407c-97a6-5ed3bae6a024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:45.408238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f8a6-75de-407c-97a6-5ed3bae6a024 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:45.408527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f8a6-75de-407c-97a6-5ed3bae6a024 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:45.408801 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f8a6-75de-407c-97a6-5ed3bae6a024 None admin] PATH_INFO: `/v3/services/network` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:45.409393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19f8a6-75de-407c-97a6-5ed3bae6a024 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:45.410878 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19f8a6-75de-407c-97a6-5ed3bae6a024 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:45.415570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d0b5b-e058-4c90-9b30-6a9dbb2e953c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:45.417064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d0b5b-e058-4c90-9b30-6a9dbb2e953c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-aa19f8a6-75de-407c-97a6-5ed3bae6a024 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:45.422699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:45.428487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:45.429308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 381/763] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:45 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:45.430099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4689d-dfcd-4cee-b45b-fdacd6add5e8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:45.430099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4689d-dfcd-4cee-b45b-fdacd6add5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:45.430099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4689d-dfcd-4cee-b45b-fdacd6add5e8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:45.430099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 382/764] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:45.431291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4689d-dfcd-4cee-b45b-fdacd6add5e8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:45.437361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:45.530178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 383/765] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:13:45.531559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a714575-ae7c-496a-8944-44a55b2e854d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:45.531869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a714575-ae7c-496a-8944-44a55b2e854d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:45.532204 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a714575-ae7c-496a-8944-44a55b2e854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:45.544648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4689d-dfcd-4cee-b45b-fdacd6add5e8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:45.554122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4a714575-ae7c-496a-8944-44a55b2e854d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:45.556094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4a714575-ae7c-496a-8944-44a55b2e854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:45.580545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232c9f5-dd95-4926-b87b-12eb474f95b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:45.581480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232c9f5-dd95-4926-b87b-12eb474f95b3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:45.581938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232c9f5-dd95-4926-b87b-12eb474f95b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:45.582391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232c9f5-dd95-4926-b87b-12eb474f95b3 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:45.583201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232c9f5-dd95-4926-b87b-12eb474f95b3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:45.583681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232c9f5-dd95-4926-b87b-12eb474f95b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:45.585392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232c9f5-dd95-4926-b87b-12eb474f95b3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:45.590756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 383/766] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:13:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:45.591757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232c9f5-dd95-4926-b87b-12eb474f95b3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:45.592268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:45.640116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 384/767] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:45.641149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a714575-ae7c-496a-8944-44a55b2e854d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:45.660858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:45.697367 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232c9f5-dd95-4926-b87b-12eb474f95b3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:45.732941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab3bb6-e974-4263-b5e8-9a6cbf151b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:45.733727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab3bb6-e974-4263-b5e8-9a6cbf151b63 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:45.734107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab3bb6-e974-4263-b5e8-9a6cbf151b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:45.734482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab3bb6-e974-4263-b5e8-9a6cbf151b63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:45.746094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab3bb6-e974-4263-b5e8-9a6cbf151b63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:45.747698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab3bb6-e974-4263-b5e8-9a6cbf151b63 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-87ab3bb6-e974-4263-b5e8-9a6cbf151b63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:45.763622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:45.764677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:45.765562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:45.765562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:45.765562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:45.767079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 384/768] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:45.773846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab3bb6-e974-4263-b5e8-9a6cbf151b63 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:45.824418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a714575-ae7c-496a-8944-44a55b2e854d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:45.900461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f039f-9f05-473f-b089-df5728f16dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:45.901051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f039f-9f05-473f-b089-df5728f16dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:45.901340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f039f-9f05-473f-b089-df5728f16dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:45.901613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f039f-9f05-473f-b089-df5728f16dd3 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:45.902745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f039f-9f05-473f-b089-df5728f16dd3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:45.903063 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f039f-9f05-473f-b089-df5728f16dd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:45.904462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f039f-9f05-473f-b089-df5728f16dd3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:45.920204 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 385/769] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:13:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:45.925598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f039f-9f05-473f-b089-df5728f16dd3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:45.969057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab3bb6-e974-4263-b5e8-9a6cbf151b63 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:45.984086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:46.004275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:46.029987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece9110-071e-4a44-a370-7c70a4f796b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:46.030616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece9110-071e-4a44-a370-7c70a4f796b7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.030894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece9110-071e-4a44-a370-7c70a4f796b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.031164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece9110-071e-4a44-a370-7c70a4f796b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.031812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece9110-071e-4a44-a370-7c70a4f796b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:46.032202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece9110-071e-4a44-a370-7c70a4f796b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:46.033598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece9110-071e-4a44-a370-7c70a4f796b7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:46.046554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 385/770] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:46.047391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece9110-071e-4a44-a370-7c70a4f796b7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:46.076003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f039f-9f05-473f-b089-df5728f16dd3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:46.113435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d44f-0ba4-47f7-990a-0360550f8323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:46.114055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d44f-0ba4-47f7-990a-0360550f8323 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.114341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d44f-0ba4-47f7-990a-0360550f8323 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.114620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d44f-0ba4-47f7-990a-0360550f8323 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.115325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058d44f-0ba4-47f7-990a-0360550f8323 None admin] RBAC: Adding query filter params (interface=public, service_id=eecb9fcc5509487d9883c4cb9fc794c8, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:46.115638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058d44f-0ba4-47f7-990a-0360550f8323 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:46.117154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058d44f-0ba4-47f7-990a-0360550f8323 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:46.125360 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 386/771] 10.222.0.55 () {56 vars in 1251 bytes} [Fri Sep 2 09:13:45 2022] GET /identity/v3/endpoints?service_id=eecb9fcc5509487d9883c4cb9fc794c8&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:46.126258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d44f-0ba4-47f7-990a-0360550f8323 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:46.152137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece9110-071e-4a44-a370-7c70a4f796b7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:46.192214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c39571-f20a-4c21-abf4-d7f5b244e7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:46.192853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c39571-f20a-4c21-abf4-d7f5b244e7fd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.193133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c39571-f20a-4c21-abf4-d7f5b244e7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.193469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c39571-f20a-4c21-abf4-d7f5b244e7fd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.194063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c39571-f20a-4c21-abf4-d7f5b244e7fd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:46.195462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c39571-f20a-4c21-abf4-d7f5b244e7fd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-04c39571-f20a-4c21-abf4-d7f5b244e7fd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:46.205518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:46.206483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:46.207294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 386/772] 10.222.0.55 () {56 vars in 1129 bytes} [Fri Sep 2 09:13:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:46.208116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c39571-f20a-4c21-abf4-d7f5b244e7fd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:46.228933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:46.237672 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d44f-0ba4-47f7-990a-0360550f8323 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:46.253930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:46.271266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ef66d-9486-40b6-962e-620fc481841f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:46.271923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ef66d-9486-40b6-962e-620fc481841f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.272700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ef66d-9486-40b6-962e-620fc481841f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.273778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ef66d-9486-40b6-962e-620fc481841f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.280985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ef66d-9486-40b6-962e-620fc481841f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:46.282554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ef66d-9486-40b6-962e-620fc481841f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a74ef66d-9486-40b6-962e-620fc481841f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:46.294692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:46.295603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:46.296528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:46.296528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:46.296528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:46.296528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:46.296528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:46.296528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:46.296528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:46.296528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:46.296528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 387/773] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:46.297018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ef66d-9486-40b6-962e-620fc481841f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:46.315431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c39571-f20a-4c21-abf4-d7f5b244e7fd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:46.351319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29980af-978a-4776-9318-313a5dac35d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:46.351961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29980af-978a-4776-9318-313a5dac35d2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.352245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29980af-978a-4776-9318-313a5dac35d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.352515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29980af-978a-4776-9318-313a5dac35d2 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.353111 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29980af-978a-4776-9318-313a5dac35d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:46.354485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29980af-978a-4776-9318-313a5dac35d2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:46.367917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 387/774] 10.222.0.55 () {56 vars in 1087 bytes} [Fri Sep 2 09:13:46 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:46.367917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e34ea-761c-4b50-9226-a258f45682ed None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.367917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e34ea-761c-4b50-9226-a258f45682ed None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.367917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e34ea-761c-4b50-9226-a258f45682ed None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.367917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 388/775] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:46.367917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e34ea-761c-4b50-9226-a258f45682ed None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:46.426910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ef66d-9486-40b6-962e-620fc481841f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:46.474834 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a520a-0635-4779-a69e-17a4ad29fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:46.475607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a520a-0635-4779-a69e-17a4ad29fc3d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.476002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a520a-0635-4779-a69e-17a4ad29fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.476341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a520a-0635-4779-a69e-17a4ad29fc3d None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.477050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a520a-0635-4779-a69e-17a4ad29fc3d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:46.477421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a520a-0635-4779-a69e-17a4ad29fc3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:46.478874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a520a-0635-4779-a69e-17a4ad29fc3d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:46.489345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 388/776] 10.222.0.55 () {56 vars in 1124 bytes} [Fri Sep 2 09:13:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:46.490774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c244253-a1ca-437a-94e4-dafd86ed43ad None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.491169 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c244253-a1ca-437a-94e4-dafd86ed43ad None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.491527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c244253-a1ca-437a-94e4-dafd86ed43ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.492032 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e34ea-761c-4b50-9226-a258f45682ed None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:46.503316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:46.514361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7c244253-a1ca-437a-94e4-dafd86ed43ad None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:46.516770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7c244253-a1ca-437a-94e4-dafd86ed43ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:46.528949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:46.542052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68360578-1290-46ef-8df3-b6f58a39432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:46.542668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68360578-1290-46ef-8df3-b6f58a39432a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.542977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68360578-1290-46ef-8df3-b6f58a39432a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.545439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68360578-1290-46ef-8df3-b6f58a39432a None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.545439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68360578-1290-46ef-8df3-b6f58a39432a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:46.545439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68360578-1290-46ef-8df3-b6f58a39432a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:46.545819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68360578-1290-46ef-8df3-b6f58a39432a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:46.558430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 389/777] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:46.559974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68360578-1290-46ef-8df3-b6f58a39432a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:46.593319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 389/778] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:46.594159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c244253-a1ca-437a-94e4-dafd86ed43ad None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:46.703152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c244253-a1ca-437a-94e4-dafd86ed43ad None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:46.717842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68360578-1290-46ef-8df3-b6f58a39432a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:46.740073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705159-d8fc-4483-93c5-dceae27d5738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:46.741018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705159-d8fc-4483-93c5-dceae27d5738 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.741503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705159-d8fc-4483-93c5-dceae27d5738 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.741980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705159-d8fc-4483-93c5-dceae27d5738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.742991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac705159-d8fc-4483-93c5-dceae27d5738 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=01367d6c12014bc0bc9410b4a5a98693) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:46.743522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac705159-d8fc-4483-93c5-dceae27d5738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:46.745455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac705159-d8fc-4483-93c5-dceae27d5738 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:46.752327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 390/779] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:46 2022] GET /identity/v3/role_assignments?user.id=01367d6c12014bc0bc9410b4a5a98693&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=04d1bc62091440e189989e4b973a6627 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:46.785331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e94124-1ffc-4a01-b406-d0c5e1ba6b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:46.786339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e94124-1ffc-4a01-b406-d0c5e1ba6b8b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:46.786935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e94124-1ffc-4a01-b406-d0c5e1ba6b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:46.787465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e94124-1ffc-4a01-b406-d0c5e1ba6b8b None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:46.788358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e94124-1ffc-4a01-b406-d0c5e1ba6b8b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:46.788880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e94124-1ffc-4a01-b406-d0c5e1ba6b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:46.790708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e94124-1ffc-4a01-b406-d0c5e1ba6b8b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:46.803569 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 390/780] 10.222.0.55 () {56 vars in 1124 bytes} [Fri Sep 2 09:13:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:46.810100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705159-d8fc-4483-93c5-dceae27d5738 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:46.843993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:46.948329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e94124-1ffc-4a01-b406-d0c5e1ba6b8b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:46.972194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705159-d8fc-4483-93c5-dceae27d5738 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:46.989301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:47.023742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdff55-3817-4cb3-b8fb-069003073ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:47.024646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdff55-3817-4cb3-b8fb-069003073ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:47.025030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdff55-3817-4cb3-b8fb-069003073ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:47.025312 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdff55-3817-4cb3-b8fb-069003073ea4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:47.026170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdff55-3817-4cb3-b8fb-069003073ea4 None admin] RBAC: Adding query filter params (interface=public, service_id=83bcd159340c4b61b1b2304c7a699a32, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:47.026473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdff55-3817-4cb3-b8fb-069003073ea4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:47.028492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdff55-3817-4cb3-b8fb-069003073ea4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:47.035111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 391/781] 10.222.0.55 () {56 vars in 1251 bytes} [Fri Sep 2 09:13:46 2022] GET /identity/v3/endpoints?service_id=83bcd159340c4b61b1b2304c7a699a32&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:47.036916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a050f87-e9ff-424e-8973-a8621551c09e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:47.037198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a050f87-e9ff-424e-8973-a8621551c09e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:47.037466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a050f87-e9ff-424e-8973-a8621551c09e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:47.042851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 392/782] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:47.044311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a050f87-e9ff-424e-8973-a8621551c09e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:47.084818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e94124-1ffc-4a01-b406-d0c5e1ba6b8b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:47.132807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243f5f7-607f-4774-90ae-6d7e0060b218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:47.133681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243f5f7-607f-4774-90ae-6d7e0060b218 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:47.133959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243f5f7-607f-4774-90ae-6d7e0060b218 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:47.134227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243f5f7-607f-4774-90ae-6d7e0060b218 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:47.140608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:47.149571 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243f5f7-607f-4774-90ae-6d7e0060b218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-2243f5f7-607f-4774-90ae-6d7e0060b218 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:47.163278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:47.164542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 391/783] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:47.165553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7e625-8587-4c02-b0f8-ed9fcd338f44 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:47.166445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7e625-8587-4c02-b0f8-ed9fcd338f44 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:47.166445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7e625-8587-4c02-b0f8-ed9fcd338f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:47.174739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a050f87-e9ff-424e-8973-a8621551c09e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:47.188590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f4c7e625-8587-4c02-b0f8-ed9fcd338f44 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:47.190269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f4c7e625-8587-4c02-b0f8-ed9fcd338f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:47.216351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171087e1-294a-40c7-8144-770f6199fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:47.217205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171087e1-294a-40c7-8144-770f6199fe9b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:47.217622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171087e1-294a-40c7-8144-770f6199fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:47.217997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171087e1-294a-40c7-8144-770f6199fe9b None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:47.219021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171087e1-294a-40c7-8144-770f6199fe9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:47.220398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171087e1-294a-40c7-8144-770f6199fe9b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:47.232512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 393/784] 10.222.0.55 () {56 vars in 1087 bytes} [Fri Sep 2 09:13:47 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:47.233661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171087e1-294a-40c7-8144-770f6199fe9b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:47.279293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 392/785] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:47.373381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171087e1-294a-40c7-8144-770f6199fe9b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:47.409686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3d80-c174-4f78-a202-a6bed1cc7f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:47.410550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3d80-c174-4f78-a202-a6bed1cc7f9e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:47.410965 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3d80-c174-4f78-a202-a6bed1cc7f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:47.411385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3d80-c174-4f78-a202-a6bed1cc7f9e None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:47.412198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3d80-c174-4f78-a202-a6bed1cc7f9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:47.412633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3d80-c174-4f78-a202-a6bed1cc7f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:47.414167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3d80-c174-4f78-a202-a6bed1cc7f9e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:47.420237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:47.423766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 394/786] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:47.430019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7e625-8587-4c02-b0f8-ed9fcd338f44 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:47.458876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:47.532742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7e625-8587-4c02-b0f8-ed9fcd338f44 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:47.567158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b5f6e-ef19-4e01-a770-7daf59b93837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:47.567783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b5f6e-ef19-4e01-a770-7daf59b93837 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:47.568086 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b5f6e-ef19-4e01-a770-7daf59b93837 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:47.568356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b5f6e-ef19-4e01-a770-7daf59b93837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:47.578411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b5f6e-ef19-4e01-a770-7daf59b93837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:47.579851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b5f6e-ef19-4e01-a770-7daf59b93837 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e44b5f6e-ef19-4e01-a770-7daf59b93837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:47.594770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:47.595771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:47.596699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:47.596699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:47.596699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:47.596699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 393/787] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:47.605055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3d80-c174-4f78-a202-a6bed1cc7f9e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:47.633838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b5f6e-ef19-4e01-a770-7daf59b93837 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:47.720336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:47.750978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b5f6e-ef19-4e01-a770-7daf59b93837 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:47.791721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d5a40-8f15-4930-ad5c-0e23120ab7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:47.792295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5a40-8f15-4930-ad5c-0e23120ab7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:47.792570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5a40-8f15-4930-ad5c-0e23120ab7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:47.792840 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5a40-8f15-4930-ad5c-0e23120ab7a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:47.803183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d5a40-8f15-4930-ad5c-0e23120ab7a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-175d5a40-8f15-4930-ad5c-0e23120ab7a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:47.808456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:47.809410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:47.810243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 394/788] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:47.815265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d5a40-8f15-4930-ad5c-0e23120ab7a1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:47.818128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3d80-c174-4f78-a202-a6bed1cc7f9e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:47.888546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadad75c-4e81-4b72-91e4-ec95d0c3266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:47.889208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad75c-4e81-4b72-91e4-ec95d0c3266b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:47.889413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad75c-4e81-4b72-91e4-ec95d0c3266b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:47.889685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad75c-4e81-4b72-91e4-ec95d0c3266b None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:47.890322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadad75c-4e81-4b72-91e4-ec95d0c3266b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:47.890619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadad75c-4e81-4b72-91e4-ec95d0c3266b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:47.892018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadad75c-4e81-4b72-91e4-ec95d0c3266b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:47.905086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 395/789] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:47.916305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadad75c-4e81-4b72-91e4-ec95d0c3266b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:47.922462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d5a40-8f15-4930-ad5c-0e23120ab7a1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:47.952429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:47.959248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831ad2a-42cb-45aa-b62f-19e606ad1727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:47.959895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ad2a-42cb-45aa-b62f-19e606ad1727 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:47.961715 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ad2a-42cb-45aa-b62f-19e606ad1727 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:47.961990 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ad2a-42cb-45aa-b62f-19e606ad1727 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:47.963523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831ad2a-42cb-45aa-b62f-19e606ad1727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:47.969541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831ad2a-42cb-45aa-b62f-19e606ad1727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:47.969541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831ad2a-42cb-45aa-b62f-19e606ad1727 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:47.989018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 395/790] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:47.995044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831ad2a-42cb-45aa-b62f-19e606ad1727 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:48.012824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:48.058575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadad75c-4e81-4b72-91e4-ec95d0c3266b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:48.095536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2c24e-6b2e-4fd0-90c1-5b0ebe488922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:48.096560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2c24e-6b2e-4fd0-90c1-5b0ebe488922 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:48.097039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2c24e-6b2e-4fd0-90c1-5b0ebe488922 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:48.097514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2c24e-6b2e-4fd0-90c1-5b0ebe488922 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:48.105285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2c24e-6b2e-4fd0-90c1-5b0ebe488922 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:48.107173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2c24e-6b2e-4fd0-90c1-5b0ebe488922 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-42c2c24e-6b2e-4fd0-90c1-5b0ebe488922 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:48.129356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:48.130336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:48.131253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:48.131253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:48.131253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:48.131253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:48.131253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:48.131253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:48.131253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:48.131253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:48.131253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:13:48.131253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:48.133814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 396/791] 10.222.0.55 () {56 vars in 1117 bytes} [Fri Sep 2 09:13:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:48.139496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2c24e-6b2e-4fd0-90c1-5b0ebe488922 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:48.249872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2c24e-6b2e-4fd0-90c1-5b0ebe488922 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:48.266538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831ad2a-42cb-45aa-b62f-19e606ad1727 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:48.288316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:48.294558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442182e-c34f-459f-af1c-47bcf0d98721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:48.295169 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442182e-c34f-459f-af1c-47bcf0d98721 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:48.295443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442182e-c34f-459f-af1c-47bcf0d98721 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:48.295710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442182e-c34f-459f-af1c-47bcf0d98721 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:48.296852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442182e-c34f-459f-af1c-47bcf0d98721 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:48.297155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442182e-c34f-459f-af1c-47bcf0d98721 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:48.298896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442182e-c34f-459f-af1c-47bcf0d98721 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:48.320065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 397/792] 10.222.0.55 () {56 vars in 1149 bytes} [Fri Sep 2 09:13:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:48.332909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442182e-c34f-459f-af1c-47bcf0d98721 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:48.353132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b395e-7098-4a2c-8614-b6e66fdc3e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:48.354093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b395e-7098-4a2c-8614-b6e66fdc3e46 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:48.354589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b395e-7098-4a2c-8614-b6e66fdc3e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:48.355019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b395e-7098-4a2c-8614-b6e66fdc3e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:48.378436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b395e-7098-4a2c-8614-b6e66fdc3e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:48.380243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b395e-7098-4a2c-8614-b6e66fdc3e46 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-9f9b395e-7098-4a2c-8614-b6e66fdc3e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:48.413296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:48.414547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:48.415661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:48.415661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:48.415661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:48.419454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 396/793] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:48.420566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b395e-7098-4a2c-8614-b6e66fdc3e46 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:48.476806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442182e-c34f-459f-af1c-47bcf0d98721 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:48.517404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ff374-fda9-418b-825e-e6c3e85a3d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:48.518293 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ff374-fda9-418b-825e-e6c3e85a3d13 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:48.518981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ff374-fda9-418b-825e-e6c3e85a3d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:48.520103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ff374-fda9-418b-825e-e6c3e85a3d13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:48.525921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:48.542302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ff374-fda9-418b-825e-e6c3e85a3d13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:48.544345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ff374-fda9-418b-825e-e6c3e85a3d13 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7c6ff374-fda9-418b-825e-e6c3e85a3d13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:48.575729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:48.576953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:48.578047 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:48.578047 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:48.578047 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:48.584976 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 398/794] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:48.591369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ff374-fda9-418b-825e-e6c3e85a3d13 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:48.637904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b395e-7098-4a2c-8614-b6e66fdc3e46 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:48.657691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:48.701772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f71221-3446-4227-90b0-cefebaf6c257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:48.702682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f71221-3446-4227-90b0-cefebaf6c257 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:48.703162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f71221-3446-4227-90b0-cefebaf6c257 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:48.703604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f71221-3446-4227-90b0-cefebaf6c257 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:48.704468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f71221-3446-4227-90b0-cefebaf6c257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:48.705498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f71221-3446-4227-90b0-cefebaf6c257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:48.707140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f71221-3446-4227-90b0-cefebaf6c257 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:48.722716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 397/795] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:48.724492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfa1d2-841a-4bff-b79f-e232e10cfc57 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:48.724971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfa1d2-841a-4bff-b79f-e232e10cfc57 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:48.725413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfa1d2-841a-4bff-b79f-e232e10cfc57 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:48.727289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 398/796] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:48.728276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfa1d2-841a-4bff-b79f-e232e10cfc57 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:48.752207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ff374-fda9-418b-825e-e6c3e85a3d13 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:48.788145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a010cb2-f496-4f72-95fd-cbb4ca6dbee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:48.788835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a010cb2-f496-4f72-95fd-cbb4ca6dbee1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:48.789203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a010cb2-f496-4f72-95fd-cbb4ca6dbee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:48.789620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a010cb2-f496-4f72-95fd-cbb4ca6dbee1 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:48.790434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a010cb2-f496-4f72-95fd-cbb4ca6dbee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:48.790801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a010cb2-f496-4f72-95fd-cbb4ca6dbee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:48.792416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a010cb2-f496-4f72-95fd-cbb4ca6dbee1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:48.810568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 399/797] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:48.812006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af8b08-ec0a-4eb0-a295-7ceca9fdfc09 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:48.812610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af8b08-ec0a-4eb0-a295-7ceca9fdfc09 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:48.812720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af8b08-ec0a-4eb0-a295-7ceca9fdfc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:48.840805 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfa1d2-841a-4bff-b79f-e232e10cfc57 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:48.842653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-76af8b08-ec0a-4eb0-a295-7ceca9fdfc09 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:48.844283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-76af8b08-ec0a-4eb0-a295-7ceca9fdfc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:48.849409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:48.878332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf0cc6-ce1b-4248-b914-d958fe3877ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:48.879153 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0cc6-ce1b-4248-b914-d958fe3877ec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:48.879524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0cc6-ce1b-4248-b914-d958fe3877ec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:48.879917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0cc6-ce1b-4248-b914-d958fe3877ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:48.888368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf0cc6-ce1b-4248-b914-d958fe3877ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:48.890481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf0cc6-ce1b-4248-b914-d958fe3877ec None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-00cf0cc6-ce1b-4248-b914-d958fe3877ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:48.903535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:48.904707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:48.905682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:48.905682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:48.905682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:48.905682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:48.905682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:48.905682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:48.905682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:48.905682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:48.905682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:13:48.905682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:48.906241 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 399/798] 10.222.0.55 () {56 vars in 1093 bytes} [Fri Sep 2 09:13:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:48.907413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf0cc6-ce1b-4248-b914-d958fe3877ec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:48.927991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 400/799] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:48.929591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af8b08-ec0a-4eb0-a295-7ceca9fdfc09 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:48.963744 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:49.017006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf0cc6-ce1b-4248-b914-d958fe3877ec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:49.060616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9e6b9-6a5c-4069-b690-7637443e5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:49.061333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9e6b9-6a5c-4069-b690-7637443e5a11 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.061693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9e6b9-6a5c-4069-b690-7637443e5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.062028 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9e6b9-6a5c-4069-b690-7637443e5a11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.069080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9e6b9-6a5c-4069-b690-7637443e5a11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:49.070597 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9e6b9-6a5c-4069-b690-7637443e5a11 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:49.071108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af8b08-ec0a-4eb0-a295-7ceca9fdfc09 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f1d9e6b9-6a5c-4069-b690-7637443e5a11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:49.082695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:49.083613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:49.084529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:49.084529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:49.084529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:49.084529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:49.084529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:49.084529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:49.084529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:49.084529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:49.084529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 400/800] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:49.089613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dc86f-91be-432f-889b-92eecd153a3b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.089613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dc86f-91be-432f-889b-92eecd153a3b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.089613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dc86f-91be-432f-889b-92eecd153a3b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.089613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 401/801] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:49.090491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dc86f-91be-432f-889b-92eecd153a3b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:49.116440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860ed9b-4613-4612-b261-40e7318fa7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:49.117098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860ed9b-4613-4612-b261-40e7318fa7fc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.117372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860ed9b-4613-4612-b261-40e7318fa7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.117638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860ed9b-4613-4612-b261-40e7318fa7fc None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.118424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860ed9b-4613-4612-b261-40e7318fa7fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:49.118759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860ed9b-4613-4612-b261-40e7318fa7fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:49.120518 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860ed9b-4613-4612-b261-40e7318fa7fc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:49.126560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:49.140369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 401/802] 10.222.0.55 () {56 vars in 1133 bytes} [Fri Sep 2 09:13:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:49.141619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065c5d-b523-412e-9c7a-588851181f1a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.141894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065c5d-b523-412e-9c7a-588851181f1a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.142167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065c5d-b523-412e-9c7a-588851181f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.164621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-92065c5d-b523-412e-9c7a-588851181f1a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:49.165788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-92065c5d-b523-412e-9c7a-588851181f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:49.227183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dc86f-91be-432f-889b-92eecd153a3b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:49.251907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 402/803] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:49.251907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065c5d-b523-412e-9c7a-588851181f1a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:49.261936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:49.275802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96f9f9-89ae-442b-ab46-cc26e4194d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:49.276537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96f9f9-89ae-442b-ab46-cc26e4194d46 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.276832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96f9f9-89ae-442b-ab46-cc26e4194d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.277094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96f9f9-89ae-442b-ab46-cc26e4194d46 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.278182 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96f9f9-89ae-442b-ab46-cc26e4194d46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:49.278486 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96f9f9-89ae-442b-ab46-cc26e4194d46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:49.280214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96f9f9-89ae-442b-ab46-cc26e4194d46 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:49.297848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 402/804] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:49.298744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96f9f9-89ae-442b-ab46-cc26e4194d46 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:49.370733 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065c5d-b523-412e-9c7a-588851181f1a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:49.384297 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:49.400919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96f9f9-89ae-442b-ab46-cc26e4194d46 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:49.414905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618583b4-e6c7-43a8-bea9-9ef0a5d6b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:49.415518 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618583b4-e6c7-43a8-bea9-9ef0a5d6b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.418765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618583b4-e6c7-43a8-bea9-9ef0a5d6b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.418765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618583b4-e6c7-43a8-bea9-9ef0a5d6b0a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.442150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba033e-2c1c-418e-b5b7-ed25814c4045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:49.442928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba033e-2c1c-418e-b5b7-ed25814c4045 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.443329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba033e-2c1c-418e-b5b7-ed25814c4045 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.443705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba033e-2c1c-418e-b5b7-ed25814c4045 None admin] PATH_INFO: `/v3/services/network` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.445509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba033e-2c1c-418e-b5b7-ed25814c4045 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:49.447112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba033e-2c1c-418e-b5b7-ed25814c4045 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-87ba033e-2c1c-418e-b5b7-ed25814c4045 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:49.458867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:49.459844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 09:13:49.460688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:49.469693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 403/805] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:49 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:49.470773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba033e-2c1c-418e-b5b7-ed25814c4045 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:49.504352 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618583b4-e6c7-43a8-bea9-9ef0a5d6b0a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:49.506136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618583b4-e6c7-43a8-bea9-9ef0a5d6b0a2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:49.518481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:49.586093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba033e-2c1c-418e-b5b7-ed25814c4045 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:49.616111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 403/806] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:13:49.616947 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618583b4-e6c7-43a8-bea9-9ef0a5d6b0a2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:49.621011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d1d68-1a0c-4b9d-85e9-7a3c43561ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:49.621649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1d68-1a0c-4b9d-85e9-7a3c43561ceb None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.621928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1d68-1a0c-4b9d-85e9-7a3c43561ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.622204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1d68-1a0c-4b9d-85e9-7a3c43561ceb None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/2195f7f3cd1d4f35826282958378c754/roles/8f47585e7ab1400689facb80e605e850` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.636524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d1d68-1a0c-4b9d-85e9-7a3c43561ceb None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=2195f7f3cd1d4f35826282958378c754, role_id=8f47585e7ab1400689facb80e605e850)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:49.637987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d1d68-1a0c-4b9d-85e9-7a3c43561ceb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:49.695767 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:49.699893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 404/807] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:13:49 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/2195f7f3cd1d4f35826282958378c754/roles/8f47585e7ab1400689facb80e605e850 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:13:49.700702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d1d68-1a0c-4b9d-85e9-7a3c43561ceb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:49.716200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618583b4-e6c7-43a8-bea9-9ef0a5d6b0a2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:49.726928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:49.756062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee8277-8fb1-412b-a53a-f825631c5fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:49.756701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8277-8fb1-412b-a53a-f825631c5fad None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.756979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8277-8fb1-412b-a53a-f825631c5fad None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.757249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8277-8fb1-412b-a53a-f825631c5fad None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.757882 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee8277-8fb1-412b-a53a-f825631c5fad None admin] RBAC: Adding query filter params (name=network) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:49.758198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee8277-8fb1-412b-a53a-f825631c5fad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:49.759565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee8277-8fb1-412b-a53a-f825631c5fad None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:49.769404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 404/808] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:13:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:49.769404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb64009-b97d-41e0-9d4f-30160637ab9d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.769404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb64009-b97d-41e0-9d4f-30160637ab9d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.769404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb64009-b97d-41e0-9d4f-30160637ab9d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.769404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 405/809] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:49.769404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb64009-b97d-41e0-9d4f-30160637ab9d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:49.828188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d1d68-1a0c-4b9d-85e9-7a3c43561ceb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:49.881043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a8b2c-8870-43f2-8e6a-f0d51c78ee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:49.882089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8b2c-8870-43f2-8e6a-f0d51c78ee28 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.882970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8b2c-8870-43f2-8e6a-f0d51c78ee28 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.883481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8b2c-8870-43f2-8e6a-f0d51c78ee28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.895790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a8b2c-8870-43f2-8e6a-f0d51c78ee28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:49.896737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb64009-b97d-41e0-9d4f-30160637ab9d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-322a8b2c-8870-43f2-8e6a-f0d51c78ee28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:49.900725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:49.901644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:49.903174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 405/810] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:49.904552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a8b2c-8870-43f2-8e6a-f0d51c78ee28 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:49.935875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635010d-fee1-499d-844a-b4d6b63b1c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:49.936649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635010d-fee1-499d-844a-b4d6b63b1c26 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.936931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635010d-fee1-499d-844a-b4d6b63b1c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.937208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635010d-fee1-499d-844a-b4d6b63b1c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.948597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635010d-fee1-499d-844a-b4d6b63b1c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:49.950579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635010d-fee1-499d-844a-b4d6b63b1c26 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6635010d-fee1-499d-844a-b4d6b63b1c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:49.966235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:49.967356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:49.973018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:49.973018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:49.973018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:49.973018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 406/811] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:49.973018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f550f59-68a3-4a68-9cba-80284fb0381e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:49.973018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f550f59-68a3-4a68-9cba-80284fb0381e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:49.973018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f550f59-68a3-4a68-9cba-80284fb0381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:49.979764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:49.986747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6f550f59-68a3-4a68-9cba-80284fb0381e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:49.987962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6f550f59-68a3-4a68-9cba-80284fb0381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:50.006019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:50.024139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a8b2c-8870-43f2-8e6a-f0d51c78ee28 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:50.057988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 407/812] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:50.059081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f550f59-68a3-4a68-9cba-80284fb0381e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:50.066432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c44d11-cc13-4eed-8c71-69c3214d4edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:50.067056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44d11-cc13-4eed-8c71-69c3214d4edc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:50.067333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44d11-cc13-4eed-8c71-69c3214d4edc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:50.067796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44d11-cc13-4eed-8c71-69c3214d4edc None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:50.068570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c44d11-cc13-4eed-8c71-69c3214d4edc None admin] RBAC: Adding query filter params (type=network) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:50.068964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c44d11-cc13-4eed-8c71-69c3214d4edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:50.070468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c44d11-cc13-4eed-8c71-69c3214d4edc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:50.080236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 406/813] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:13:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:50.081244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c44d11-cc13-4eed-8c71-69c3214d4edc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:50.188630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c44d11-cc13-4eed-8c71-69c3214d4edc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:50.190831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f550f59-68a3-4a68-9cba-80284fb0381e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:50.212319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:50.223577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b584b-879b-4bae-85ab-28d911adc2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:50.226249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b584b-879b-4bae-85ab-28d911adc2ea None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:50.226249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b584b-879b-4bae-85ab-28d911adc2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:50.226249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b584b-879b-4bae-85ab-28d911adc2ea None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:50.226249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b584b-879b-4bae-85ab-28d911adc2ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:50.226249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b584b-879b-4bae-85ab-28d911adc2ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:50.226961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b584b-879b-4bae-85ab-28d911adc2ea None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:50.231574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b25ea-d1cd-4c4d-9ccc-6413fb6ee6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:50.232456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b25ea-d1cd-4c4d-9ccc-6413fb6ee6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:50.232938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b25ea-d1cd-4c4d-9ccc-6413fb6ee6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:50.233417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b25ea-d1cd-4c4d-9ccc-6413fb6ee6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:50.234262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b25ea-d1cd-4c4d-9ccc-6413fb6ee6b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:50.234753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b25ea-d1cd-4c4d-9ccc-6413fb6ee6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:50.236400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b25ea-d1cd-4c4d-9ccc-6413fb6ee6b9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:50.243332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 407/814] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:50.243332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b584b-879b-4bae-85ab-28d911adc2ea None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:50.256338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 408/815] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:50.257369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b25ea-d1cd-4c4d-9ccc-6413fb6ee6b9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:50.277398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:50.352173 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b584b-879b-4bae-85ab-28d911adc2ea None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:50.369512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b25ea-d1cd-4c4d-9ccc-6413fb6ee6b9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:50.390681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497a93-29cd-44e7-820a-24c4f7b0c5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:50.391290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497a93-29cd-44e7-820a-24c4f7b0c5ee None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:50.391789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497a93-29cd-44e7-820a-24c4f7b0c5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:50.391981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497a93-29cd-44e7-820a-24c4f7b0c5ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:50.392517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25497a93-29cd-44e7-820a-24c4f7b0c5ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:50.393890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25497a93-29cd-44e7-820a-24c4f7b0c5ee None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:50.405968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7cb30-8417-41c5-a9dc-c0721e598027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:50.406602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7cb30-8417-41c5-a9dc-c0721e598027 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:50.406889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7cb30-8417-41c5-a9dc-c0721e598027 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:50.407146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7cb30-8417-41c5-a9dc-c0721e598027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:50.413656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7cb30-8417-41c5-a9dc-c0721e598027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:50.416502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7cb30-8417-41c5-a9dc-c0721e598027 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-47f7cb30-8417-41c5-a9dc-c0721e598027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:50.426234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:50.427309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:50.428250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:50.428250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:50.428250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:50.428250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:50.428250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:50.428250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:50.428250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:50.428250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:50.428250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 409/816] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:50.428758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7cb30-8417-41c5-a9dc-c0721e598027 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:50.489322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 408/817] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:13:50 2022] POST /identity/v3/endpoints => generated 337 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:13:50.490066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497a93-29cd-44e7-820a-24c4f7b0c5ee None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:50.519151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:50.545649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7cb30-8417-41c5-a9dc-c0721e598027 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:50.551589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:50.596628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829c20f-8ba3-4e0c-89aa-86db56fc6cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:50.597636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829c20f-8ba3-4e0c-89aa-86db56fc6cec None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:50.598571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829c20f-8ba3-4e0c-89aa-86db56fc6cec None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:50.600186 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829c20f-8ba3-4e0c-89aa-86db56fc6cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:50.616118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829c20f-8ba3-4e0c-89aa-86db56fc6cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:50.618382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829c20f-8ba3-4e0c-89aa-86db56fc6cec None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:50.639900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497a93-29cd-44e7-820a-24c4f7b0c5ee None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1829c20f-8ba3-4e0c-89aa-86db56fc6cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:50.640600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:50.641683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:50.642765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:50.642765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:50.642765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:50.645874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 410/818] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:50.647006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829c20f-8ba3-4e0c-89aa-86db56fc6cec None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:50.696854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bda23-7221-4201-a998-e3218385772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:50.697785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bda23-7221-4201-a998-e3218385772e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:50.698166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bda23-7221-4201-a998-e3218385772e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:50.698541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bda23-7221-4201-a998-e3218385772e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:50.699229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bda23-7221-4201-a998-e3218385772e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:50.700907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bda23-7221-4201-a998-e3218385772e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b45bda23-7221-4201-a998-e3218385772e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:50.710757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:50.712082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 09:13:50.713181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:50.716184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 409/819] 10.222.0.55 () {56 vars in 1129 bytes} [Fri Sep 2 09:13:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:50.716968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bda23-7221-4201-a998-e3218385772e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:50.780339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829c20f-8ba3-4e0c-89aa-86db56fc6cec None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:50.805600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:50.816440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a640cb7-6bed-4bbd-bc7c-7d5eb52899ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:50.817333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a640cb7-6bed-4bbd-bc7c-7d5eb52899ed None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:50.817333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a640cb7-6bed-4bbd-bc7c-7d5eb52899ed None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:50.817568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a640cb7-6bed-4bbd-bc7c-7d5eb52899ed None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:50.818245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a640cb7-6bed-4bbd-bc7c-7d5eb52899ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:50.818545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a640cb7-6bed-4bbd-bc7c-7d5eb52899ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:50.819996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a640cb7-6bed-4bbd-bc7c-7d5eb52899ed None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:50.838231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 411/820] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:50.839125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a640cb7-6bed-4bbd-bc7c-7d5eb52899ed None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:50.840834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bda23-7221-4201-a998-e3218385772e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:50.848435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:50.880288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766e8f-386c-4dd8-8734-fe7a06695723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:50.880883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766e8f-386c-4dd8-8734-fe7a06695723 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:50.881156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766e8f-386c-4dd8-8734-fe7a06695723 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:50.881417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766e8f-386c-4dd8-8734-fe7a06695723 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:50.882044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766e8f-386c-4dd8-8734-fe7a06695723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:50.882339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766e8f-386c-4dd8-8734-fe7a06695723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:50.883704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766e8f-386c-4dd8-8734-fe7a06695723 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:50.896459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 410/821] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:50.897151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766e8f-386c-4dd8-8734-fe7a06695723 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:50.944632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a640cb7-6bed-4bbd-bc7c-7d5eb52899ed None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:50.978550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5868c4-b070-4581-956f-30c8655a3eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:50.979143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5868c4-b070-4581-956f-30c8655a3eaa None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:50.979415 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5868c4-b070-4581-956f-30c8655a3eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:50.979679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5868c4-b070-4581-956f-30c8655a3eaa None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:50.980320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5868c4-b070-4581-956f-30c8655a3eaa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:50.980615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5868c4-b070-4581-956f-30c8655a3eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:50.981993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5868c4-b070-4581-956f-30c8655a3eaa None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:50.986313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 412/822] 10.222.0.55 () {56 vars in 1124 bytes} [Fri Sep 2 09:13:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:50.987077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5868c4-b070-4581-956f-30c8655a3eaa None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:51.005406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766e8f-386c-4dd8-8734-fe7a06695723 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:51.041125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea38e-907d-426f-8e04-190ccc4c5782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:51.041749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea38e-907d-426f-8e04-190ccc4c5782 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:51.041911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea38e-907d-426f-8e04-190ccc4c5782 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:51.042167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea38e-907d-426f-8e04-190ccc4c5782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:51.042877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aea38e-907d-426f-8e04-190ccc4c5782 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=5d74d78932554527a8bcb5880b2b9c96) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:51.043205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aea38e-907d-426f-8e04-190ccc4c5782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:51.043765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:51.045450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aea38e-907d-426f-8e04-190ccc4c5782 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:51.059942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 411/823] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:50 2022] GET /identity/v3/role_assignments?user.id=5d74d78932554527a8bcb5880b2b9c96&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=04d1bc62091440e189989e4b973a6627 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:51.060700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea38e-907d-426f-8e04-190ccc4c5782 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:51.101839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5868c4-b070-4581-956f-30c8655a3eaa None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:51.106818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:51.142701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f7454-32b7-4a4c-ba1a-8a4d3b0f972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:51.143358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f7454-32b7-4a4c-ba1a-8a4d3b0f972b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:51.143636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f7454-32b7-4a4c-ba1a-8a4d3b0f972b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:51.143930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f7454-32b7-4a4c-ba1a-8a4d3b0f972b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:51.153557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f7454-32b7-4a4c-ba1a-8a4d3b0f972b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:51.155048 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f7454-32b7-4a4c-ba1a-8a4d3b0f972b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-dd5f7454-32b7-4a4c-ba1a-8a4d3b0f972b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:51.168831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:51.169853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:51.171185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 413/824] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:51.175785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f7454-32b7-4a4c-ba1a-8a4d3b0f972b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:51.201055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea38e-907d-426f-8e04-190ccc4c5782 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:51.237751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edba2-3348-4c15-baa9-5cee127a4fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:51.238369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edba2-3348-4c15-baa9-5cee127a4fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:51.238641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edba2-3348-4c15-baa9-5cee127a4fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:51.238908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edba2-3348-4c15-baa9-5cee127a4fd2 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:51.239527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4edba2-3348-4c15-baa9-5cee127a4fd2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:51.239823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4edba2-3348-4c15-baa9-5cee127a4fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:51.241248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4edba2-3348-4c15-baa9-5cee127a4fd2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:51.247585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 412/825] 10.222.0.55 () {56 vars in 1124 bytes} [Fri Sep 2 09:13:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:51.254559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edba2-3348-4c15-baa9-5cee127a4fd2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:51.306582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f7454-32b7-4a4c-ba1a-8a4d3b0f972b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:51.317000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:51.349005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f8582-b812-4db0-9aca-5ee3cc32ca83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:51.349777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f8582-b812-4db0-9aca-5ee3cc32ca83 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:51.350056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f8582-b812-4db0-9aca-5ee3cc32ca83 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:51.350369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f8582-b812-4db0-9aca-5ee3cc32ca83 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:51.352004 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f8582-b812-4db0-9aca-5ee3cc32ca83 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:51.352314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f8582-b812-4db0-9aca-5ee3cc32ca83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:51.353804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f8582-b812-4db0-9aca-5ee3cc32ca83 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:51.380033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 414/826] 10.222.0.55 () {56 vars in 1135 bytes} [Fri Sep 2 09:13:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:51.382539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:51.385567 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f8582-b812-4db0-9aca-5ee3cc32ca83 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:51.393665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edba2-3348-4c15-baa9-5cee127a4fd2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:51.438294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07406b9b-74db-4230-b0b0-33f9db92edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:51.439583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07406b9b-74db-4230-b0b0-33f9db92edeb None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:51.440273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07406b9b-74db-4230-b0b0-33f9db92edeb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:51.440686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07406b9b-74db-4230-b0b0-33f9db92edeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:51.441747 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07406b9b-74db-4230-b0b0-33f9db92edeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:51.444031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07406b9b-74db-4230-b0b0-33f9db92edeb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:51.499100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f8582-b812-4db0-9aca-5ee3cc32ca83 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:51.516165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 413/827] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:13:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:13:51.551065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce68dea-f1ae-4823-9284-177e0670e50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:51.551710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68dea-f1ae-4823-9284-177e0670e50f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:51.552013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68dea-f1ae-4823-9284-177e0670e50f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:51.552281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68dea-f1ae-4823-9284-177e0670e50f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:51.565094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce68dea-f1ae-4823-9284-177e0670e50f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:51.566563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce68dea-f1ae-4823-9284-177e0670e50f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-5ce68dea-f1ae-4823-9284-177e0670e50f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:51.584285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:51.585291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:51.586601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:51.586601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:51.586601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:51.586601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 415/828] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:51.592588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07406b9b-74db-4230-b0b0-33f9db92edeb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:51.614068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd502b-2b75-4b3d-b5ec-6352c4b0b2d6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:51.614342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd502b-2b75-4b3d-b5ec-6352c4b0b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:51.614613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd502b-2b75-4b3d-b5ec-6352c4b0b2d6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:51.615982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 416/829] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:13:51.621900 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c983d0e-de6b-441d-b71e-7eaf2fb6b17a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:51.622316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c983d0e-de6b-441d-b71e-7eaf2fb6b17a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:51.622659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c983d0e-de6b-441d-b71e-7eaf2fb6b17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:51.643172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5c983d0e-de6b-441d-b71e-7eaf2fb6b17a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:51.644710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c983d0e-de6b-441d-b71e-7eaf2fb6b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:51.656619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:51.725164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07406b9b-74db-4230-b0b0-33f9db92edeb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:51.729051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 417/830] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:13:51.767188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fde50-850d-46ca-9903-bc8a4f8ee0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:51.767797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fde50-850d-46ca-9903-bc8a4f8ee0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:51.768118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fde50-850d-46ca-9903-bc8a4f8ee0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:51.768385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fde50-850d-46ca-9903-bc8a4f8ee0b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:51.769020 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fde50-850d-46ca-9903-bc8a4f8ee0b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:51.769315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fde50-850d-46ca-9903-bc8a4f8ee0b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:51.770677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fde50-850d-46ca-9903-bc8a4f8ee0b0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:51.783679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 414/831] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:51.789361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c983d0e-de6b-441d-b71e-7eaf2fb6b17a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:51.895163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c983d0e-de6b-441d-b71e-7eaf2fb6b17a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:51.930734 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695a77-4d0f-416a-a375-53284739387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:51.931370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695a77-4d0f-416a-a375-53284739387d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:51.931648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695a77-4d0f-416a-a375-53284739387d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:51.931940 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695a77-4d0f-416a-a375-53284739387d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:51.939339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0695a77-4d0f-416a-a375-53284739387d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:51.940805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0695a77-4d0f-416a-a375-53284739387d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e0695a77-4d0f-416a-a375-53284739387d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:51.952640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:51.953917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:51.955183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:51.955183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:51.955183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:51.955183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:51.955183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:51.955183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:51.955183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:51.955183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:51.955183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 418/832] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:51.959444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fde50-850d-46ca-9903-bc8a4f8ee0b0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:51.974178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:52.016906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695a77-4d0f-416a-a375-53284739387d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:52.021653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:52.070145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fde50-850d-46ca-9903-bc8a4f8ee0b0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:52.108560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9128e-e55f-4078-b6ae-5cd4921523ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:52.109143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9128e-e55f-4078-b6ae-5cd4921523ec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:52.109471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9128e-e55f-4078-b6ae-5cd4921523ec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:52.109745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9128e-e55f-4078-b6ae-5cd4921523ec None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:52.110490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9128e-e55f-4078-b6ae-5cd4921523ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:52.110800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9128e-e55f-4078-b6ae-5cd4921523ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:52.112276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9128e-e55f-4078-b6ae-5cd4921523ec None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:52.127278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 415/833] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:52.133846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9128e-e55f-4078-b6ae-5cd4921523ec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:52.149283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695a77-4d0f-416a-a375-53284739387d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:52.192145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60ffb9-a6c9-4d5f-9971-01fd71232a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:52.193644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ffb9-a6c9-4d5f-9971-01fd71232a32 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:52.194200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ffb9-a6c9-4d5f-9971-01fd71232a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:52.194689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ffb9-a6c9-4d5f-9971-01fd71232a32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:52.209181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60ffb9-a6c9-4d5f-9971-01fd71232a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-af60ffb9-a6c9-4d5f-9971-01fd71232a32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:52.216630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:52.217535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:13:52.218368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:52.220006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:52.221978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 419/834] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:13:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:52.227531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60ffb9-a6c9-4d5f-9971-01fd71232a32 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:52.260323 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9128e-e55f-4078-b6ae-5cd4921523ec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:52.297767 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa7779-3e4f-4b2b-b458-bba6f1ec96a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:52.298584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa7779-3e4f-4b2b-b458-bba6f1ec96a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:52.298979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa7779-3e4f-4b2b-b458-bba6f1ec96a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:52.299379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa7779-3e4f-4b2b-b458-bba6f1ec96a7 None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/01367d6c12014bc0bc9410b4a5a98693/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:52.301428 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa7779-3e4f-4b2b-b458-bba6f1ec96a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=01367d6c12014bc0bc9410b4a5a98693, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:52.303046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa7779-3e4f-4b2b-b458-bba6f1ec96a7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:52.315274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:52.351501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60ffb9-a6c9-4d5f-9971-01fd71232a32 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:52.383445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 416/835] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:13:52 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/01367d6c12014bc0bc9410b4a5a98693/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:13:52.391699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f91f9-62ba-44d5-83de-f8460011971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:52.392794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f91f9-62ba-44d5-83de-f8460011971f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:52.393275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f91f9-62ba-44d5-83de-f8460011971f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:52.393771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f91f9-62ba-44d5-83de-f8460011971f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:52.394687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f91f9-62ba-44d5-83de-f8460011971f None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:52.395194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f91f9-62ba-44d5-83de-f8460011971f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:52.397091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f91f9-62ba-44d5-83de-f8460011971f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:52.408041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 420/836] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:13:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:52.413889 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa7779-3e4f-4b2b-b458-bba6f1ec96a7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:52.645511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa7779-3e4f-4b2b-b458-bba6f1ec96a7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:52.673565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:52.682108 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c10b5c-cde3-4145-ae17-737c4b5c01e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:52.682737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c10b5c-cde3-4145-ae17-737c4b5c01e3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:52.683008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c10b5c-cde3-4145-ae17-737c4b5c01e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:52.683269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c10b5c-cde3-4145-ae17-737c4b5c01e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:52.693675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c10b5c-cde3-4145-ae17-737c4b5c01e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:52.695145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c10b5c-cde3-4145-ae17-737c4b5c01e3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-04c10b5c-cde3-4145-ae17-737c4b5c01e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:52.711084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:52.712093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:52.712978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:52.712978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:52.712978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:52.712978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 417/837] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:52.718689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f91f9-62ba-44d5-83de-f8460011971f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:52.830709 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f91f9-62ba-44d5-83de-f8460011971f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:52.858219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:52.867460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4cbfd-adbf-4ad9-814c-5c8c2ef48359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:52.868104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4cbfd-adbf-4ad9-814c-5c8c2ef48359 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:52.868382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4cbfd-adbf-4ad9-814c-5c8c2ef48359 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:52.868658 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4cbfd-adbf-4ad9-814c-5c8c2ef48359 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:52.869546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4cbfd-adbf-4ad9-814c-5c8c2ef48359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:52.872928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4cbfd-adbf-4ad9-814c-5c8c2ef48359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:52.872928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4cbfd-adbf-4ad9-814c-5c8c2ef48359 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:52.883299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 421/838] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:52.889488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c10b5c-cde3-4145-ae17-737c4b5c01e3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:52.993921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c10b5c-cde3-4145-ae17-737c4b5c01e3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:53.030789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181acd2a-af8a-41fe-a850-a9ab70e512eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:53.031781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181acd2a-af8a-41fe-a850-a9ab70e512eb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:53.032284 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181acd2a-af8a-41fe-a850-a9ab70e512eb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:53.032771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181acd2a-af8a-41fe-a850-a9ab70e512eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:53.040140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181acd2a-af8a-41fe-a850-a9ab70e512eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:53.041803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181acd2a-af8a-41fe-a850-a9ab70e512eb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-181acd2a-af8a-41fe-a850-a9ab70e512eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:53.053616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:53.054554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:53.055497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:53.055497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:53.055497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:53.055497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:53.055497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:53.055497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:53.055497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:53.055497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:53.055497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:13:53.055497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:53.062434 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 418/839] 10.222.0.55 () {56 vars in 1117 bytes} [Fri Sep 2 09:13:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:53.064076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4cbfd-adbf-4ad9-814c-5c8c2ef48359 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:53.100938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8193e57-aed0-4047-8549-30622ab1a05d None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:53.101444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8193e57-aed0-4047-8549-30622ab1a05d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:53.101444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8193e57-aed0-4047-8549-30622ab1a05d None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:53.102913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 419/840] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:53.107841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c52f91-1c87-4375-98f1-6a76b236c46d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:53.108172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c52f91-1c87-4375-98f1-6a76b236c46d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:53.108418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c52f91-1c87-4375-98f1-6a76b236c46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:53.126767 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-41c52f91-1c87-4375-98f1-6a76b236c46d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:53.128329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-41c52f91-1c87-4375-98f1-6a76b236c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:53.166669 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:53.184869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4cbfd-adbf-4ad9-814c-5c8c2ef48359 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:53.205021 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 420/841] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:13:53.228475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588c107-20d4-4e1e-912d-5b980552706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:53.229363 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588c107-20d4-4e1e-912d-5b980552706c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:53.229818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588c107-20d4-4e1e-912d-5b980552706c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:53.230300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588c107-20d4-4e1e-912d-5b980552706c None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:53.231252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588c107-20d4-4e1e-912d-5b980552706c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:53.231732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588c107-20d4-4e1e-912d-5b980552706c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:53.233387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588c107-20d4-4e1e-912d-5b980552706c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:53.253592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 422/842] 10.222.0.55 () {56 vars in 1149 bytes} [Fri Sep 2 09:13:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:53.260993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c52f91-1c87-4375-98f1-6a76b236c46d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:53.365407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c52f91-1c87-4375-98f1-6a76b236c46d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:53.401047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9766d01-f137-4712-afa6-8d5a95a5b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:53.401645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766d01-f137-4712-afa6-8d5a95a5b1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:53.401955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766d01-f137-4712-afa6-8d5a95a5b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:53.402280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766d01-f137-4712-afa6-8d5a95a5b1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:53.442193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:53.479837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9766d01-f137-4712-afa6-8d5a95a5b1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:53.479837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9766d01-f137-4712-afa6-8d5a95a5b1d5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:53.533300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588c107-20d4-4e1e-912d-5b980552706c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:53.592496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 421/843] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:53 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:13:53.592724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:53.594977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9766d01-f137-4712-afa6-8d5a95a5b1d5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:53.650423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588c107-20d4-4e1e-912d-5b980552706c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:53.669715 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:53.685571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3e31e-cbd4-4092-a965-934091b3ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:53.686196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e31e-cbd4-4092-a965-934091b3ddca None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:53.686471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e31e-cbd4-4092-a965-934091b3ddca None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:53.686745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e31e-cbd4-4092-a965-934091b3ddca None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:53.687315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3e31e-cbd4-4092-a965-934091b3ddca None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:53.688715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3e31e-cbd4-4092-a965-934091b3ddca None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9aa3e31e-cbd4-4092-a965-934091b3ddca None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:53.697335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:53.698406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:53.699301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 423/844] 10.222.0.55 () {56 vars in 1132 bytes} [Fri Sep 2 09:13:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:53.700238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c1228-ff09-4d58-a11e-9be427ea4609 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:53.700238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c1228-ff09-4d58-a11e-9be427ea4609 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:53.700238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c1228-ff09-4d58-a11e-9be427ea4609 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:53.701451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 424/845] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:53.706016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c1228-ff09-4d58-a11e-9be427ea4609 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:53.709603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9766d01-f137-4712-afa6-8d5a95a5b1d5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:53.744854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e50408-9c83-4172-a164-582ee276eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:53.745474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e50408-9c83-4172-a164-582ee276eddc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:53.745859 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e50408-9c83-4172-a164-582ee276eddc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:53.746130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e50408-9c83-4172-a164-582ee276eddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:53.757312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e50408-9c83-4172-a164-582ee276eddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:53.758746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e50408-9c83-4172-a164-582ee276eddc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-38e50408-9c83-4172-a164-582ee276eddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:53.773149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:53.774094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:53.775011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:53.775011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:53.775011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:53.775011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 422/846] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:53.775649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdeb9a-04bd-4242-99d3-429cfd42baa2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:53.775649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdeb9a-04bd-4242-99d3-429cfd42baa2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:53.775941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdeb9a-04bd-4242-99d3-429cfd42baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:53.793901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c7bdeb9a-04bd-4242-99d3-429cfd42baa2 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:53.795019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c7bdeb9a-04bd-4242-99d3-429cfd42baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:53.816542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c1228-ff09-4d58-a11e-9be427ea4609 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:53.825614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:53.853794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7de27f-46da-4a38-8570-21abe0ed22df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:53.854601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de27f-46da-4a38-8570-21abe0ed22df None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:53.854875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de27f-46da-4a38-8570-21abe0ed22df None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:53.855142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de27f-46da-4a38-8570-21abe0ed22df None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:53.855762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7de27f-46da-4a38-8570-21abe0ed22df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:53.856617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7de27f-46da-4a38-8570-21abe0ed22df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:53.857968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7de27f-46da-4a38-8570-21abe0ed22df None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:53.863381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 425/847] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:13:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:53.864300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7de27f-46da-4a38-8570-21abe0ed22df None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:53.873532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 423/848] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:53.874577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdeb9a-04bd-4242-99d3-429cfd42baa2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:53.935289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:53.990406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdeb9a-04bd-4242-99d3-429cfd42baa2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:54.008712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7de27f-46da-4a38-8570-21abe0ed22df None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:54.026679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18be9b8-cb6f-4e39-b57f-fdf94dcbb4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:54.027559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be9b8-cb6f-4e39-b57f-fdf94dcbb4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:54.028591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be9b8-cb6f-4e39-b57f-fdf94dcbb4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:54.029067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be9b8-cb6f-4e39-b57f-fdf94dcbb4b2 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:54.029908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18be9b8-cb6f-4e39-b57f-fdf94dcbb4b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:54.030406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18be9b8-cb6f-4e39-b57f-fdf94dcbb4b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:54.031992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18be9b8-cb6f-4e39-b57f-fdf94dcbb4b2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:54.037421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 424/849] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:13:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:54.054572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a7dcb-7d26-427d-8e97-f53b6eca2c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:54.055149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a7dcb-7d26-427d-8e97-f53b6eca2c64 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:54.055488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a7dcb-7d26-427d-8e97-f53b6eca2c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:54.055767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a7dcb-7d26-427d-8e97-f53b6eca2c64 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:54.056509 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a7dcb-7d26-427d-8e97-f53b6eca2c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:54.056814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a7dcb-7d26-427d-8e97-f53b6eca2c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:54.058301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a7dcb-7d26-427d-8e97-f53b6eca2c64 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:54.073438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 426/850] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:54.079155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18be9b8-cb6f-4e39-b57f-fdf94dcbb4b2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:54.149548 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a7dcb-7d26-427d-8e97-f53b6eca2c64 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:54.185902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:54.210055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18be9b8-cb6f-4e39-b57f-fdf94dcbb4b2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:54.227424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:54.249131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d34f62-72d6-436c-9bab-6e6339deca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:54.250247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d34f62-72d6-436c-9bab-6e6339deca58 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:54.250726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d34f62-72d6-436c-9bab-6e6339deca58 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:54.251174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d34f62-72d6-436c-9bab-6e6339deca58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:54.259418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d34f62-72d6-436c-9bab-6e6339deca58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:54.261377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d34f62-72d6-436c-9bab-6e6339deca58 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-06d34f62-72d6-436c-9bab-6e6339deca58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:54.275210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:54.276166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:54.277050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:54.277050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:54.277050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:54.277050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:54.277050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:54.277050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:54.277050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:54.277050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:54.277472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a7dcb-7d26-427d-8e97-f53b6eca2c64 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:54.279570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 425/851] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:54.288910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d34f62-72d6-436c-9bab-6e6339deca58 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:54.316568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b4848-b195-4b23-864f-4069cebe2377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:54.317178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4848-b195-4b23-864f-4069cebe2377 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:54.317463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4848-b195-4b23-864f-4069cebe2377 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:54.317738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4848-b195-4b23-864f-4069cebe2377 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:54.318318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b4848-b195-4b23-864f-4069cebe2377 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:54.319683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b4848-b195-4b23-864f-4069cebe2377 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e29b4848-b195-4b23-864f-4069cebe2377 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:54.329316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:54.330289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:54.331113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 427/852] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:13:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:54.339395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b4848-b195-4b23-864f-4069cebe2377 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:54.407790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d34f62-72d6-436c-9bab-6e6339deca58 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:54.448605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aece4f-81d3-4eb1-ab49-dd9e96cdc43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:54.449214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aece4f-81d3-4eb1-ab49-dd9e96cdc43e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:54.450158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aece4f-81d3-4eb1-ab49-dd9e96cdc43e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:54.450537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aece4f-81d3-4eb1-ab49-dd9e96cdc43e None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:54.451236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aece4f-81d3-4eb1-ab49-dd9e96cdc43e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:54.451593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aece4f-81d3-4eb1-ab49-dd9e96cdc43e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:54.453746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aece4f-81d3-4eb1-ab49-dd9e96cdc43e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:54.466225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 426/853] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:54.467334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab926b-bc82-4929-a0c1-5ec717aea559 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:54.467708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab926b-bc82-4929-a0c1-5ec717aea559 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:54.468027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab926b-bc82-4929-a0c1-5ec717aea559 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:54.471959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 427/854] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:54.472168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab926b-bc82-4929-a0c1-5ec717aea559 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:54.476540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:54.483408 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b4848-b195-4b23-864f-4069cebe2377 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:54.512741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:54.518220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16db709-6951-4e81-9a28-256a0a9b5b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:54.518825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16db709-6951-4e81-9a28-256a0a9b5b31 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:54.519098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16db709-6951-4e81-9a28-256a0a9b5b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:54.519369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16db709-6951-4e81-9a28-256a0a9b5b31 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:54.520147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16db709-6951-4e81-9a28-256a0a9b5b31 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:54.520474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16db709-6951-4e81-9a28-256a0a9b5b31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:54.531673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16db709-6951-4e81-9a28-256a0a9b5b31 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:54.531673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 428/855] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:13:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:54.531673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d0a3b-dead-49db-8ab2-80d9a235feda None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:54.531673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d0a3b-dead-49db-8ab2-80d9a235feda None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:54.531673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d0a3b-dead-49db-8ab2-80d9a235feda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:54.548549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bd9d0a3b-dead-49db-8ab2-80d9a235feda None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:54.549763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bd9d0a3b-dead-49db-8ab2-80d9a235feda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:54.590288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab926b-bc82-4929-a0c1-5ec717aea559 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:54.620823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 429/856] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:54.622176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d0a3b-dead-49db-8ab2-80d9a235feda None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:54.630552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bf780-1dbf-4cb8-b173-89c7f78958a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:54.631223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bf780-1dbf-4cb8-b173-89c7f78958a5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:54.631564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bf780-1dbf-4cb8-b173-89c7f78958a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:54.631950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bf780-1dbf-4cb8-b173-89c7f78958a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:54.632735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bf780-1dbf-4cb8-b173-89c7f78958a5 None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=2195f7f3cd1d4f35826282958378c754) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:54.633131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bf780-1dbf-4cb8-b173-89c7f78958a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:54.634687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bf780-1dbf-4cb8-b173-89c7f78958a5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:54.651913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 428/857] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:54 2022] GET /identity/v3/role_assignments?user.id=2195f7f3cd1d4f35826282958378c754&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:54.737014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:54.747158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d0a3b-dead-49db-8ab2-80d9a235feda None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:54.788071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa1531-cdc5-4306-ba02-ea584c9786f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:54.788688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa1531-cdc5-4306-ba02-ea584c9786f5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:54.788964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa1531-cdc5-4306-ba02-ea584c9786f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:54.789234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa1531-cdc5-4306-ba02-ea584c9786f5 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:54.789864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa1531-cdc5-4306-ba02-ea584c9786f5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:54.790171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa1531-cdc5-4306-ba02-ea584c9786f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:54.791531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa1531-cdc5-4306-ba02-ea584c9786f5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:54.797384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 430/858] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:13:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:54.928455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bf780-1dbf-4cb8-b173-89c7f78958a5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:55.034617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:55.038222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bf780-1dbf-4cb8-b173-89c7f78958a5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:55.073460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd7328-60a4-4187-844f-8575d3465441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:55.074481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7328-60a4-4187-844f-8575d3465441 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:55.075011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7328-60a4-4187-844f-8575d3465441 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:55.075544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7328-60a4-4187-844f-8575d3465441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:55.087233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd7328-60a4-4187-844f-8575d3465441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-79dd7328-60a4-4187-844f-8575d3465441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:55.093167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:55.094079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:13:55.094944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:55.097539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 429/859] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:55.103532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa1531-cdc5-4306-ba02-ea584c9786f5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:55.212231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa1531-cdc5-4306-ba02-ea584c9786f5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:55.248266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955a2a3-fd5f-442c-9ce7-e4ecb305bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:55.248876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955a2a3-fd5f-442c-9ce7-e4ecb305bf59 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:55.249152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955a2a3-fd5f-442c-9ce7-e4ecb305bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:55.249425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955a2a3-fd5f-442c-9ce7-e4ecb305bf59 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:55.250079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955a2a3-fd5f-442c-9ce7-e4ecb305bf59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:55.250374 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955a2a3-fd5f-442c-9ce7-e4ecb305bf59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:55.251730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955a2a3-fd5f-442c-9ce7-e4ecb305bf59 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:55.260539 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 431/860] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:55.266508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd7328-60a4-4187-844f-8575d3465441 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:55.374591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd7328-60a4-4187-844f-8575d3465441 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:55.411015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753c265-6f5f-4da1-a751-52191c13ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:55.412026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753c265-6f5f-4da1-a751-52191c13ec74 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:55.412483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753c265-6f5f-4da1-a751-52191c13ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:55.412932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753c265-6f5f-4da1-a751-52191c13ec74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:55.423943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753c265-6f5f-4da1-a751-52191c13ec74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:55.425657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753c265-6f5f-4da1-a751-52191c13ec74 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-c753c265-6f5f-4da1-a751-52191c13ec74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:55.440226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:55.441158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:55.442057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:55.442057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:55.442057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:55.443739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 430/861] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:55.453027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955a2a3-fd5f-442c-9ce7-e4ecb305bf59 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:55.472854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:55.555594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955a2a3-fd5f-442c-9ce7-e4ecb305bf59 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:55.591915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ace89-71cb-4fc8-83c2-65856174dca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:55.593160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ace89-71cb-4fc8-83c2-65856174dca5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:55.593160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ace89-71cb-4fc8-83c2-65856174dca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:55.593160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ace89-71cb-4fc8-83c2-65856174dca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:55.593535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ace89-71cb-4fc8-83c2-65856174dca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:55.594235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ace89-71cb-4fc8-83c2-65856174dca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:55.595176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ace89-71cb-4fc8-83c2-65856174dca5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:55.607405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 432/862] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:55.612953 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753c265-6f5f-4da1-a751-52191c13ec74 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:55.631037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:55.719731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753c265-6f5f-4da1-a751-52191c13ec74 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:55.755380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1300a85-8cb0-4b7a-9b29-fb0fe0de410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:55.756441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1300a85-8cb0-4b7a-9b29-fb0fe0de410e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:55.756949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1300a85-8cb0-4b7a-9b29-fb0fe0de410e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:55.757431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1300a85-8cb0-4b7a-9b29-fb0fe0de410e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:55.765887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1300a85-8cb0-4b7a-9b29-fb0fe0de410e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:55.767546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1300a85-8cb0-4b7a-9b29-fb0fe0de410e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b1300a85-8cb0-4b7a-9b29-fb0fe0de410e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:55.779371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:55.780359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:55.781313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:55.781313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:55.781313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:55.781313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:55.781313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:55.781313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:55.781313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:55.781313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:55.781313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 09:13:55.781313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:55.783835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 431/863] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:13:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:55.789762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ace89-71cb-4fc8-83c2-65856174dca5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:55.872957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:55.898498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ace89-71cb-4fc8-83c2-65856174dca5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:55.935805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3020c3-21d4-4ff2-a428-0f11ddb55901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:55.936502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3020c3-21d4-4ff2-a428-0f11ddb55901 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:55.936790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3020c3-21d4-4ff2-a428-0f11ddb55901 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:55.937061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3020c3-21d4-4ff2-a428-0f11ddb55901 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:55.937787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3020c3-21d4-4ff2-a428-0f11ddb55901 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:55.938090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3020c3-21d4-4ff2-a428-0f11ddb55901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:55.939522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3020c3-21d4-4ff2-a428-0f11ddb55901 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:55.959012 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 433/864] 10.222.0.55 () {56 vars in 1135 bytes} [Fri Sep 2 09:13:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:55.964764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1300a85-8cb0-4b7a-9b29-fb0fe0de410e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:55.977459 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620b253-8b52-4e91-baa8-18215ab096c2 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:55.977775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620b253-8b52-4e91-baa8-18215ab096c2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:55.978006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620b253-8b52-4e91-baa8-18215ab096c2 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:55.979590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 434/865] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:55.985174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca67d-dea5-411d-8d95-b96bda8dc417 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:55.985453 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca67d-dea5-411d-8d95-b96bda8dc417 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:55.985724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca67d-dea5-411d-8d95-b96bda8dc417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:56.004826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-cfbca67d-dea5-411d-8d95-b96bda8dc417 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:56.005981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cfbca67d-dea5-411d-8d95-b96bda8dc417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:56.044849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:56.075068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 435/866] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:13:56.086003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1300a85-8cb0-4b7a-9b29-fb0fe0de410e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:56.122188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f07568-d839-4c50-8a37-c2a10e47ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:56.122798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f07568-d839-4c50-8a37-c2a10e47ff76 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:56.123077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f07568-d839-4c50-8a37-c2a10e47ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:56.123348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f07568-d839-4c50-8a37-c2a10e47ff76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:56.195142 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f07568-d839-4c50-8a37-c2a10e47ff76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:56.196556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f07568-d839-4c50-8a37-c2a10e47ff76 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:56.271322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:56.306521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 432/867] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:13:56.313324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca67d-dea5-411d-8d95-b96bda8dc417 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:56.344197 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f07568-d839-4c50-8a37-c2a10e47ff76 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:56.383169 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:56.422397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca67d-dea5-411d-8d95-b96bda8dc417 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:56.446041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f07568-d839-4c50-8a37-c2a10e47ff76 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:56.460427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a9324-1adc-423f-a57a-456e501d896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:56.461381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a9324-1adc-423f-a57a-456e501d896a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:56.461875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a9324-1adc-423f-a57a-456e501d896a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:56.462405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a9324-1adc-423f-a57a-456e501d896a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:56.473099 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a9324-1adc-423f-a57a-456e501d896a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:56.474784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a9324-1adc-423f-a57a-456e501d896a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:56.481321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fc050-2fbd-4756-904a-7e4c8a02ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:56.481928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fc050-2fbd-4756-904a-7e4c8a02ce4a None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:56.482202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fc050-2fbd-4756-904a-7e4c8a02ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:56.482471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fc050-2fbd-4756-904a-7e4c8a02ce4a None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:56.483137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fc050-2fbd-4756-904a-7e4c8a02ce4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:56.484593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fc050-2fbd-4756-904a-7e4c8a02ce4a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3e6a9324-1adc-423f-a57a-456e501d896a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:56.491516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:56.492519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:56.493441 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:56.493441 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:56.493441 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:56.495955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 436/868] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:56.499779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a9324-1adc-423f-a57a-456e501d896a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:56.539103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 433/869] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:13:56 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:13:56.621068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a9324-1adc-423f-a57a-456e501d896a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:56.640737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:56.669098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c2fc9-4c3f-4e89-ae9c-737b5e05f451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:56.669987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c2fc9-4c3f-4e89-ae9c-737b5e05f451 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:56.670434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c2fc9-4c3f-4e89-ae9c-737b5e05f451 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:56.670897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c2fc9-4c3f-4e89-ae9c-737b5e05f451 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:56.671679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c2fc9-4c3f-4e89-ae9c-737b5e05f451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:56.672152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c2fc9-4c3f-4e89-ae9c-737b5e05f451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:56.673671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c2fc9-4c3f-4e89-ae9c-737b5e05f451 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:56.693127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 437/870] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:56.694795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fc050-2fbd-4756-904a-7e4c8a02ce4a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:56.727952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:56.770348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d44421-6a03-4848-8b58-08c43a0fc1fe None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:56.770622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d44421-6a03-4848-8b58-08c43a0fc1fe None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:56.770893 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d44421-6a03-4848-8b58-08c43a0fc1fe None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:56.773135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 438/871] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:56.780946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc727f2-ae34-4273-b0b3-ebd52306e418 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:56.781343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc727f2-ae34-4273-b0b3-ebd52306e418 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:56.781799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc727f2-ae34-4273-b0b3-ebd52306e418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:56.803544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3cc727f2-ae34-4273-b0b3-ebd52306e418 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:56.804757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3cc727f2-ae34-4273-b0b3-ebd52306e418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:56.815316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fc050-2fbd-4756-904a-7e4c8a02ce4a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:56.854168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1b26e-5d99-4e0f-b104-0e59461ad901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:56.854797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1b26e-5d99-4e0f-b104-0e59461ad901 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:56.855074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1b26e-5d99-4e0f-b104-0e59461ad901 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:56.855341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1b26e-5d99-4e0f-b104-0e59461ad901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:56.863209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1b26e-5d99-4e0f-b104-0e59461ad901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:56.864682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1b26e-5d99-4e0f-b104-0e59461ad901 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-62b1b26e-5d99-4e0f-b104-0e59461ad901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:56.877362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:56.878439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:56.879349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:56.879349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:56.879349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:56.879349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:56.879349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:56.879349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:56.879349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:56.879349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:56.879349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 434/872] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:56.879821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77e7d8-8cdc-4b11-a4d9-e0830b7910cf None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:56.879821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77e7d8-8cdc-4b11-a4d9-e0830b7910cf None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:56.880398 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77e7d8-8cdc-4b11-a4d9-e0830b7910cf None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:56.883928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 435/873] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:56.885135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77e7d8-8cdc-4b11-a4d9-e0830b7910cf None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:56.891926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 439/874] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:56.891926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163ac2b-e9fd-485b-b9fd-4a8928a475aa None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:56.891926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163ac2b-e9fd-485b-b9fd-4a8928a475aa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:56.891926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163ac2b-e9fd-485b-b9fd-4a8928a475aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:56.908030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3163ac2b-e9fd-485b-b9fd-4a8928a475aa None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:56.909202 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3163ac2b-e9fd-485b-b9fd-4a8928a475aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:56.993869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:57.000707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 440/875] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:57.009151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77e7d8-8cdc-4b11-a4d9-e0830b7910cf None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:57.045960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70817e-37a5-4982-89cd-65aacd9fb974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:57.046567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70817e-37a5-4982-89cd-65aacd9fb974 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:57.046842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70817e-37a5-4982-89cd-65aacd9fb974 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:57.047108 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70817e-37a5-4982-89cd-65aacd9fb974 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:57.047789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70817e-37a5-4982-89cd-65aacd9fb974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:57.048111 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70817e-37a5-4982-89cd-65aacd9fb974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:57.049529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70817e-37a5-4982-89cd-65aacd9fb974 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:57.061545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 436/876] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:57.067529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163ac2b-e9fd-485b-b9fd-4a8928a475aa None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:57.103432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:57.169235 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70817e-37a5-4982-89cd-65aacd9fb974 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:57.174411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163ac2b-e9fd-485b-b9fd-4a8928a475aa None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:57.217980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36600f29-c9a8-462c-9fa4-4cc50e7465ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:57.218589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36600f29-c9a8-462c-9fa4-4cc50e7465ce None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:57.218863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36600f29-c9a8-462c-9fa4-4cc50e7465ce None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:57.219133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36600f29-c9a8-462c-9fa4-4cc50e7465ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:57.220157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36600f29-c9a8-462c-9fa4-4cc50e7465ce None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=01367d6c12014bc0bc9410b4a5a98693) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:57.220510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36600f29-c9a8-462c-9fa4-4cc50e7465ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:57.222114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36600f29-c9a8-462c-9fa4-4cc50e7465ce None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:57.232028 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 441/877] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:57 2022] GET /identity/v3/role_assignments?user.id=01367d6c12014bc0bc9410b4a5a98693&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=04d1bc62091440e189989e4b973a6627 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:57.276836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36600f29-c9a8-462c-9fa4-4cc50e7465ce None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:57.286242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70817e-37a5-4982-89cd-65aacd9fb974 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:57.339608 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af9b1a-0360-455c-8f01-1b0a1b563861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:57.346057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9b1a-0360-455c-8f01-1b0a1b563861 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:57.346057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9b1a-0360-455c-8f01-1b0a1b563861 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:57.346057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9b1a-0360-455c-8f01-1b0a1b563861 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:57.359082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af9b1a-0360-455c-8f01-1b0a1b563861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-14af9b1a-0360-455c-8f01-1b0a1b563861 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:13:57.367145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:57.368175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:13:57.369009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:57.377663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 437/878] 10.222.0.55 () {56 vars in 1120 bytes} [Fri Sep 2 09:13:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:57.379702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af9b1a-0360-455c-8f01-1b0a1b563861 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:57.385650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:57.391010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36600f29-c9a8-462c-9fa4-4cc50e7465ce None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:57.400547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:57.429692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57c2a-d2ed-4ee8-b6b1-77979b26280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:57.430291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57c2a-d2ed-4ee8-b6b1-77979b26280c None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:57.430566 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57c2a-d2ed-4ee8-b6b1-77979b26280c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:57.430829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57c2a-d2ed-4ee8-b6b1-77979b26280c None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:57.431492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f57c2a-d2ed-4ee8-b6b1-77979b26280c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:57.432966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f57c2a-d2ed-4ee8-b6b1-77979b26280c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:57.497815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af9b1a-0360-455c-8f01-1b0a1b563861 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:57.524591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 442/879] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:13:57 2022] POST /identity/v3/services => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:13:57.556269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea3d51-7d5e-4e09-a224-c33245c0fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:57.556950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3d51-7d5e-4e09-a224-c33245c0fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:57.557227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3d51-7d5e-4e09-a224-c33245c0fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:57.557549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3d51-7d5e-4e09-a224-c33245c0fcb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:57.558255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea3d51-7d5e-4e09-a224-c33245c0fcb3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:57.558557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea3d51-7d5e-4e09-a224-c33245c0fcb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:57.560106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea3d51-7d5e-4e09-a224-c33245c0fcb3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:57.570399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 438/880] 10.222.0.55 () {56 vars in 1115 bytes} [Fri Sep 2 09:13:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:13:57.576602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57c2a-d2ed-4ee8-b6b1-77979b26280c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:57.695231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57c2a-d2ed-4ee8-b6b1-77979b26280c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:57.730732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090287d1-f821-4580-8a5b-302f1d9223ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:57.731767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090287d1-f821-4580-8a5b-302f1d9223ad None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:57.732267 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090287d1-f821-4580-8a5b-302f1d9223ad None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:57.732737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090287d1-f821-4580-8a5b-302f1d9223ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:57.744122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090287d1-f821-4580-8a5b-302f1d9223ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:57.746122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090287d1-f821-4580-8a5b-302f1d9223ad None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-090287d1-f821-4580-8a5b-302f1d9223ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:57.761391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:57.762409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:57.763788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:57.763788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:57.763788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:57.765882 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 443/881] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:57.772035 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea3d51-7d5e-4e09-a224-c33245c0fcb3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:57.860356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:57.883479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea3d51-7d5e-4e09-a224-c33245c0fcb3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:57.918022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be6ebd-4a8c-48d8-b702-2c80dcce46ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:57.918669 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be6ebd-4a8c-48d8-b702-2c80dcce46ed None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:57.918949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be6ebd-4a8c-48d8-b702-2c80dcce46ed None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:57.919220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be6ebd-4a8c-48d8-b702-2c80dcce46ed None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:57.919857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be6ebd-4a8c-48d8-b702-2c80dcce46ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:57.920177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be6ebd-4a8c-48d8-b702-2c80dcce46ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:57.921608 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be6ebd-4a8c-48d8-b702-2c80dcce46ed None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:57.933656 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 439/882] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:57.939806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090287d1-f821-4580-8a5b-302f1d9223ad None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:57.952261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:58.044896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090287d1-f821-4580-8a5b-302f1d9223ad None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:58.080113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae220d39-c083-4c9e-bc03-b4e685b6920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:58.080747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae220d39-c083-4c9e-bc03-b4e685b6920f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:58.081025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae220d39-c083-4c9e-bc03-b4e685b6920f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:58.081299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae220d39-c083-4c9e-bc03-b4e685b6920f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:58.089153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae220d39-c083-4c9e-bc03-b4e685b6920f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:58.090688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae220d39-c083-4c9e-bc03-b4e685b6920f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ae220d39-c083-4c9e-bc03-b4e685b6920f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:13:58.101973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:58.102894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:58.103844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 444/883] 10.222.0.55 () {56 vars in 1117 bytes} [Fri Sep 2 09:13:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:58.109673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be6ebd-4a8c-48d8-b702-2c80dcce46ed None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:58.212519 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be6ebd-4a8c-48d8-b702-2c80dcce46ed None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:58.242245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:58.249242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c05099-d45a-4271-8b01-9b64abd1d672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:58.249847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c05099-d45a-4271-8b01-9b64abd1d672 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:58.250121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c05099-d45a-4271-8b01-9b64abd1d672 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:58.250385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c05099-d45a-4271-8b01-9b64abd1d672 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:58.251103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c05099-d45a-4271-8b01-9b64abd1d672 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:58.251399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c05099-d45a-4271-8b01-9b64abd1d672 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:58.252905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c05099-d45a-4271-8b01-9b64abd1d672 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:58.270104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 440/884] 10.222.0.55 () {56 vars in 1149 bytes} [Fri Sep 2 09:13:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:58.275807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae220d39-c083-4c9e-bc03-b4e685b6920f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:58.345760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:58.381301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae220d39-c083-4c9e-bc03-b4e685b6920f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:58.416439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015903e-593a-4877-9c53-68aaf7c8efe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:58.417180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015903e-593a-4877-9c53-68aaf7c8efe2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:58.417339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015903e-593a-4877-9c53-68aaf7c8efe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:58.417570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015903e-593a-4877-9c53-68aaf7c8efe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:58.489122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015903e-593a-4877-9c53-68aaf7c8efe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:58.490687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015903e-593a-4877-9c53-68aaf7c8efe2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:58.538315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f58e-7230-41a6-881a-7927b9887fbf None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:58.538826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f58e-7230-41a6-881a-7927b9887fbf None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:58.538826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f58e-7230-41a6-881a-7927b9887fbf None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:58.540782 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 441/885] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:13:58.549126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67282e0-5baf-472a-913a-a200c7a15d74 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:58.549417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67282e0-5baf-472a-913a-a200c7a15d74 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:58.549692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67282e0-5baf-472a-913a-a200c7a15d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:58.568109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:58.574427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f67282e0-5baf-472a-913a-a200c7a15d74 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:58.575868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f67282e0-5baf-472a-913a-a200c7a15d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:58.615611 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 445/886] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:13:58 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:13:58.616570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015903e-593a-4877-9c53-68aaf7c8efe2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:58.671784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 442/887] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:13:58.729125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015903e-593a-4877-9c53-68aaf7c8efe2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:58.765133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8274be-2410-46f0-a352-32cfa5077b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:58.766065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8274be-2410-46f0-a352-32cfa5077b95 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:58.766532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8274be-2410-46f0-a352-32cfa5077b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:58.766979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8274be-2410-46f0-a352-32cfa5077b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:58.777532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8274be-2410-46f0-a352-32cfa5077b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:58.779701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8274be-2410-46f0-a352-32cfa5077b95 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0c8274be-2410-46f0-a352-32cfa5077b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:13:58.795402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:58.796348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:13:58.797260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:13:58.797260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:13:58.797260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:58.798978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 446/888] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:13:58.805178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67282e0-5baf-472a-913a-a200c7a15d74 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:58.918386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67282e0-5baf-472a-913a-a200c7a15d74 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:58.936704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:58.954135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aef12a-98f2-483e-8ec8-3feccdcf25e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:58.955308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aef12a-98f2-483e-8ec8-3feccdcf25e5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:58.955308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aef12a-98f2-483e-8ec8-3feccdcf25e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:58.955308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aef12a-98f2-483e-8ec8-3feccdcf25e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:58.955894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aef12a-98f2-483e-8ec8-3feccdcf25e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:58.956211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aef12a-98f2-483e-8ec8-3feccdcf25e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:58.957743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aef12a-98f2-483e-8ec8-3feccdcf25e5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:58.959590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8274be-2410-46f0-a352-32cfa5077b95 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:58.970667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 443/889] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:58.976242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aef12a-98f2-483e-8ec8-3feccdcf25e5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:58.986057 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:59.074113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8274be-2410-46f0-a352-32cfa5077b95 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:59.079530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aef12a-98f2-483e-8ec8-3feccdcf25e5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:59.113313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16f3eb-3886-483c-90b2-c2039409193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:59.114293 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f3eb-3886-483c-90b2-c2039409193d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.114792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f3eb-3886-483c-90b2-c2039409193d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.115136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82334-7934-435f-9b4e-b80f6cf597cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:59.115531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f3eb-3886-483c-90b2-c2039409193d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.115769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82334-7934-435f-9b4e-b80f6cf597cc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.116121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82334-7934-435f-9b4e-b80f6cf597cc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.116447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82334-7934-435f-9b4e-b80f6cf597cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.116972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f3eb-3886-483c-90b2-c2039409193d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:59.118679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f3eb-3886-483c-90b2-c2039409193d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:59.123931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d82334-7934-435f-9b4e-b80f6cf597cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:59.125365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d82334-7934-435f-9b4e-b80f6cf597cc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0a16f3eb-3886-483c-90b2-c2039409193d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:59.129323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:59.130256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 09:13:59.131155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:13:59.134029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 447/890] 10.222.0.55 () {56 vars in 1132 bytes} [Fri Sep 2 09:13:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-03d82334-7934-435f-9b4e-b80f6cf597cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:13:59.137002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:13:59.138406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:13:59.139266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:13:59.139266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:13:59.139266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:13:59.139266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:13:59.139266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:13:59.139266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:13:59.139266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:13:59.139266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:13:59.140714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16f3eb-3886-483c-90b2-c2039409193d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:59.146053 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 444/891] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:13:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:13:59.147186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82334-7934-435f-9b4e-b80f6cf597cc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:59.188600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:59.236064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:59.251484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82334-7934-435f-9b4e-b80f6cf597cc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:59.254683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16f3eb-3886-483c-90b2-c2039409193d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:59.286945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7295686-f5f2-4b20-bd65-f1851589c724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:59.287847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7295686-f5f2-4b20-bd65-f1851589c724 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.288385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7295686-f5f2-4b20-bd65-f1851589c724 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.288873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7295686-f5f2-4b20-bd65-f1851589c724 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.289971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7295686-f5f2-4b20-bd65-f1851589c724 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:59.290563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7295686-f5f2-4b20-bd65-f1851589c724 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:59.292547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7295686-f5f2-4b20-bd65-f1851589c724 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:59.292867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeec28-93d4-4361-9923-a491659fbbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:59.293566 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeec28-93d4-4361-9923-a491659fbbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.293942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeec28-93d4-4361-9923-a491659fbbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.294294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeec28-93d4-4361-9923-a491659fbbe2 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.295009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeec28-93d4-4361-9923-a491659fbbe2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:59.295460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeec28-93d4-4361-9923-a491659fbbe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:59.297034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeec28-93d4-4361-9923-a491659fbbe2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:59.306926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 448/892] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:13:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:59.313079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeec28-93d4-4361-9923-a491659fbbe2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:59.313204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 445/893] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:59.314100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7295686-f5f2-4b20-bd65-f1851589c724 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:59.423683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeec28-93d4-4361-9923-a491659fbbe2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:59.424240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:59.428604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7295686-f5f2-4b20-bd65-f1851589c724 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:59.459326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ea684-ff1e-4fab-839e-e275e0e4d35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:59.459917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ea684-ff1e-4fab-839e-e275e0e4d35a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.460268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ea684-ff1e-4fab-839e-e275e0e4d35a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.460545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ea684-ff1e-4fab-839e-e275e0e4d35a None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.461154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ea684-ff1e-4fab-839e-e275e0e4d35a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:59.461447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ea684-ff1e-4fab-839e-e275e0e4d35a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:59.462791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ea684-ff1e-4fab-839e-e275e0e4d35a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:59.464826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7932af-937c-451f-9f6e-3a7b9723e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:59.465425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7932af-937c-451f-9f6e-3a7b9723e106 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.465728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7932af-937c-451f-9f6e-3a7b9723e106 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.465997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7932af-937c-451f-9f6e-3a7b9723e106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.466711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7932af-937c-451f-9f6e-3a7b9723e106 None admin] RBAC: Adding query filter params (role.id=ae7422720c0043d0b7f44c53804eac0c, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=2195f7f3cd1d4f35826282958378c754) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:59.467011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7932af-937c-451f-9f6e-3a7b9723e106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:59.472913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 449/894] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:13:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:59.473060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7932af-937c-451f-9f6e-3a7b9723e106 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:59.473152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010ccb-3c1f-4446-a530-337f641566a2 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.473152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010ccb-3c1f-4446-a530-337f641566a2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.473152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010ccb-3c1f-4446-a530-337f641566a2 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.475486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 450/895] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:59.476226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab010ccb-3c1f-4446-a530-337f641566a2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:59.477817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 446/896] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:13:59 2022] GET /identity/v3/role_assignments?user.id=2195f7f3cd1d4f35826282958378c754&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=ae7422720c0043d0b7f44c53804eac0c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:59.482174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c4dcc-2f9f-4012-8c1f-13ea94a436c8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.482174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c4dcc-2f9f-4012-8c1f-13ea94a436c8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.482174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c4dcc-2f9f-4012-8c1f-13ea94a436c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.498445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:59.502273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-728c4dcc-2f9f-4012-8c1f-13ea94a436c8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:59.504146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-728c4dcc-2f9f-4012-8c1f-13ea94a436c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:59.587692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 447/897] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:59.589040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e36d9-b14a-4329-b250-44557059acfa None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.589321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e36d9-b14a-4329-b250-44557059acfa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.589590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e36d9-b14a-4329-b250-44557059acfa None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.591065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 448/898] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:13:59.596542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0c23-d806-4180-af75-b7c9576b7e9e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.596824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0c23-d806-4180-af75-b7c9576b7e9e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.597082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0c23-d806-4180-af75-b7c9576b7e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.604759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab010ccb-3c1f-4446-a530-337f641566a2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:59.617636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-11ba0c23-d806-4180-af75-b7c9576b7e9e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:13:59.618850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-11ba0c23-d806-4180-af75-b7c9576b7e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:13:59.651825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000525f-f22a-447e-8d1e-cf48043ceb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:59.652749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000525f-f22a-447e-8d1e-cf48043ceb10 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.653054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000525f-f22a-447e-8d1e-cf48043ceb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.653327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000525f-f22a-447e-8d1e-cf48043ceb10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.654674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000525f-f22a-447e-8d1e-cf48043ceb10 None admin] RBAC: Adding query filter params (interface=public, service_id=7958447bc22c415aa3bcb1b24602fbb1, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:13:59.654990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000525f-f22a-447e-8d1e-cf48043ceb10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:59.656663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000525f-f22a-447e-8d1e-cf48043ceb10 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:59.665252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 451/899] 10.222.0.55 () {56 vars in 1251 bytes} [Fri Sep 2 09:13:59 2022] GET /identity/v3/endpoints?service_id=7958447bc22c415aa3bcb1b24602fbb1&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:13:59.669928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000525f-f22a-447e-8d1e-cf48043ceb10 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:59.708216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 449/900] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:13:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:13:59.755420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:59.779237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000525f-f22a-447e-8d1e-cf48043ceb10 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:13:59.815200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b38b8-f71f-482b-af86-48122e741fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:13:59.816141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b38b8-f71f-482b-af86-48122e741fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:13:59.816630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b38b8-f71f-482b-af86-48122e741fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:13:59.817114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b38b8-f71f-482b-af86-48122e741fc6 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:13:59.817889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b38b8-f71f-482b-af86-48122e741fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:13:59.819429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b38b8-f71f-482b-af86-48122e741fc6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:13:59.826008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 452/901] 10.222.0.55 () {56 vars in 1087 bytes} [Fri Sep 2 09:13:59 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:13:59.894233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba0c23-d806-4180-af75-b7c9576b7e9e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:13:59.922625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:59.981055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b38b8-f71f-482b-af86-48122e741fc6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:00.019700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba0c23-d806-4180-af75-b7c9576b7e9e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:00.058288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a3a1f-93f1-4f59-a473-aa18136598bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:00.058920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a3a1f-93f1-4f59-a473-aa18136598bb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:00.059229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a3a1f-93f1-4f59-a473-aa18136598bb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:00.060009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a3a1f-93f1-4f59-a473-aa18136598bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:00.060632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a3a1f-93f1-4f59-a473-aa18136598bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:00.062007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a3a1f-93f1-4f59-a473-aa18136598bb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b08a3a1f-93f1-4f59-a473-aa18136598bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:00.070934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:00.072170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:00.073220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 450/902] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:13:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:00.080483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a3a1f-93f1-4f59-a473-aa18136598bb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:00.128978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b38b8-f71f-482b-af86-48122e741fc6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:00.166432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f52802-c6cd-4cbb-93f4-9c2232d2369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:00.167065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f52802-c6cd-4cbb-93f4-9c2232d2369a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:00.167389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f52802-c6cd-4cbb-93f4-9c2232d2369a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:00.167665 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f52802-c6cd-4cbb-93f4-9c2232d2369a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:00.168288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f52802-c6cd-4cbb-93f4-9c2232d2369a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:00.169966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f52802-c6cd-4cbb-93f4-9c2232d2369a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a7f52802-c6cd-4cbb-93f4-9c2232d2369a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:00.178868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:00.179868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:00.180719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 453/903] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:13:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:00.186968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f52802-c6cd-4cbb-93f4-9c2232d2369a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:00.190864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:00.193210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:00.211262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a3a1f-93f1-4f59-a473-aa18136598bb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:00.256122 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f24d3-6ef1-4d1f-b9cf-50e4000fc5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:00.257644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f24d3-6ef1-4d1f-b9cf-50e4000fc5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:00.258134 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f24d3-6ef1-4d1f-b9cf-50e4000fc5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:00.258863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f24d3-6ef1-4d1f-b9cf-50e4000fc5b6 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:00.259702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f24d3-6ef1-4d1f-b9cf-50e4000fc5b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:00.260253 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f24d3-6ef1-4d1f-b9cf-50e4000fc5b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:00.263217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f24d3-6ef1-4d1f-b9cf-50e4000fc5b6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:00.274926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 451/904] 10.222.0.55 () {56 vars in 1122 bytes} [Fri Sep 2 09:14:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:00.275312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f24d3-6ef1-4d1f-b9cf-50e4000fc5b6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:00.311991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f52802-c6cd-4cbb-93f4-9c2232d2369a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:00.354893 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049638a-d497-4e53-b1ab-975084710449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:00.355792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049638a-d497-4e53-b1ab-975084710449 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:00.356812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049638a-d497-4e53-b1ab-975084710449 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:00.357366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049638a-d497-4e53-b1ab-975084710449 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:00.358275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049638a-d497-4e53-b1ab-975084710449 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:00.358773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049638a-d497-4e53-b1ab-975084710449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:00.360340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049638a-d497-4e53-b1ab-975084710449 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:00.365881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 454/905] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:14:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:00.372499 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049638a-d497-4e53-b1ab-975084710449 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:00.400459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f24d3-6ef1-4d1f-b9cf-50e4000fc5b6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:00.447131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7581d-c889-4ffe-9d61-2638f64e6118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:00.448756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7581d-c889-4ffe-9d61-2638f64e6118 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:00.449216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7581d-c889-4ffe-9d61-2638f64e6118 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:00.449660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7581d-c889-4ffe-9d61-2638f64e6118 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:00.451092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7581d-c889-4ffe-9d61-2638f64e6118 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:00.451740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7581d-c889-4ffe-9d61-2638f64e6118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:00.453408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7581d-c889-4ffe-9d61-2638f64e6118 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:00.456363 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:00.465195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 452/906] 10.222.0.55 () {56 vars in 1122 bytes} [Fri Sep 2 09:14:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:00.500640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049638a-d497-4e53-b1ab-975084710449 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:00.538974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cf70e-447a-4533-882b-c09288f5a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:00.539514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cf70e-447a-4533-882b-c09288f5a1db None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:00.539792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cf70e-447a-4533-882b-c09288f5a1db None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:00.540104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cf70e-447a-4533-882b-c09288f5a1db None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:00.540740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cf70e-447a-4533-882b-c09288f5a1db None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:00.541044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cf70e-447a-4533-882b-c09288f5a1db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:00.542424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cf70e-447a-4533-882b-c09288f5a1db None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:00.552938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 455/907] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:14:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:00.558770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7581d-c889-4ffe-9d61-2638f64e6118 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:00.577597 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:00.672253 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7581d-c889-4ffe-9d61-2638f64e6118 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:00.708387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6784e6-95cc-4674-9458-2acd73ed21f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:00.709322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6784e6-95cc-4674-9458-2acd73ed21f5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:00.709797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6784e6-95cc-4674-9458-2acd73ed21f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:00.710266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6784e6-95cc-4674-9458-2acd73ed21f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:00.711174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6784e6-95cc-4674-9458-2acd73ed21f5 None admin] RBAC: Adding query filter params (interface=public, service_id=598b25d54c7047a48716971e505b9e16, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:00.711723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6784e6-95cc-4674-9458-2acd73ed21f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:00.713296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6784e6-95cc-4674-9458-2acd73ed21f5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:00.721679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 453/908] 10.222.0.55 () {56 vars in 1251 bytes} [Fri Sep 2 09:14:00 2022] GET /identity/v3/endpoints?service_id=598b25d54c7047a48716971e505b9e16&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:00.729607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cf70e-447a-4533-882b-c09288f5a1db None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:00.833334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cf70e-447a-4533-882b-c09288f5a1db None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:00.866686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:00.872602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a020d9f-a132-4587-8377-583693271cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:00.873288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a020d9f-a132-4587-8377-583693271cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:00.873641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a020d9f-a132-4587-8377-583693271cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:00.873982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a020d9f-a132-4587-8377-583693271cc7 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:00.874683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a020d9f-a132-4587-8377-583693271cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:00.876159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a020d9f-a132-4587-8377-583693271cc7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:00.882485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 456/909] 10.222.0.55 () {56 vars in 1087 bytes} [Fri Sep 2 09:14:00 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:14:01.421781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdab6d-ae52-40f1-b178-69d004d97b83 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:01.422083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdab6d-ae52-40f1-b178-69d004d97b83 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:01.422330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdab6d-ae52-40f1-b178-69d004d97b83 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:01.424093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 454/910] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:01.429299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7cd1f-24c8-4b14-a4a4-3fc0884f552d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:01.429648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7cd1f-24c8-4b14-a4a4-3fc0884f552d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:01.429999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7cd1f-24c8-4b14-a4a4-3fc0884f552d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:01.448218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-02d7cd1f-24c8-4b14-a4a4-3fc0884f552d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:01.449382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-02d7cd1f-24c8-4b14-a4a4-3fc0884f552d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:01.520643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 457/911] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:01.792264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdab6d-ae52-40f1-b178-69d004d97b83 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:01.839785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc08ed-2c75-4073-8f97-c1823952262a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:01.840586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc08ed-2c75-4073-8f97-c1823952262a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:01.840896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc08ed-2c75-4073-8f97-c1823952262a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:01.842398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 458/912] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:01.847141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902b47-aaa1-4aed-856a-01041c62a233 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:01.847421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902b47-aaa1-4aed-856a-01041c62a233 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:01.847695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902b47-aaa1-4aed-856a-01041c62a233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:01.866330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-68902b47-aaa1-4aed-856a-01041c62a233 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:01.867741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-68902b47-aaa1-4aed-856a-01041c62a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:01.885633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:01.911155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdab6d-ae52-40f1-b178-69d004d97b83 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:01.948933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39df732-ffab-448c-821e-fcb307a65fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:01.949566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39df732-ffab-448c-821e-fcb307a65fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:01.949844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39df732-ffab-448c-821e-fcb307a65fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:01.950214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39df732-ffab-448c-821e-fcb307a65fd9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:01.955982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 459/913] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:01.964796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39df732-ffab-448c-821e-fcb307a65fd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e39df732-ffab-448c-821e-fcb307a65fd9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:01.970465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:01.971392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:01.972256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 455/914] 10.222.0.55 () {56 vars in 1120 bytes} [Fri Sep 2 09:14:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:01.977550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902b47-aaa1-4aed-856a-01041c62a233 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:02.036443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:02.085277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902b47-aaa1-4aed-856a-01041c62a233 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:02.120561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83925bf-ccc5-4c5c-a39f-5a9ca56af2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:02.121167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83925bf-ccc5-4c5c-a39f-5a9ca56af2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.121443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83925bf-ccc5-4c5c-a39f-5a9ca56af2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.121711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83925bf-ccc5-4c5c-a39f-5a9ca56af2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.122919 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83925bf-ccc5-4c5c-a39f-5a9ca56af2f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:02.123218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83925bf-ccc5-4c5c-a39f-5a9ca56af2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:02.124599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83925bf-ccc5-4c5c-a39f-5a9ca56af2f3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:02.133000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 460/915] 10.222.0.55 () {56 vars in 1115 bytes} [Fri Sep 2 09:14:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:02.138414 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39df732-ffab-448c-821e-fcb307a65fd9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:02.246595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39df732-ffab-448c-821e-fcb307a65fd9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:02.268954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83925bf-ccc5-4c5c-a39f-5a9ca56af2f3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:02.284602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698705b-e588-40a0-ba0a-13c10389d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:02.285395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698705b-e588-40a0-ba0a-13c10389d9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.285672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698705b-e588-40a0-ba0a-13c10389d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.286322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698705b-e588-40a0-ba0a-13c10389d9a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.295651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:02.301002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698705b-e588-40a0-ba0a-13c10389d9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:02.303077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698705b-e588-40a0-ba0a-13c10389d9a6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f698705b-e588-40a0-ba0a-13c10389d9a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:02.320667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:02.321644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:02.327665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:02.327665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:02.327665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:02.327665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 456/916] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:02.329741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698705b-e588-40a0-ba0a-13c10389d9a6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:02.402346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83925bf-ccc5-4c5c-a39f-5a9ca56af2f3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:02.426854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:02.450384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9d686-9d1c-4273-bf23-68001a8aa6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:02.451353 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9d686-9d1c-4273-bf23-68001a8aa6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.451844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9d686-9d1c-4273-bf23-68001a8aa6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.452359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9d686-9d1c-4273-bf23-68001a8aa6d5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.453144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9d686-9d1c-4273-bf23-68001a8aa6d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:02.455692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9d686-9d1c-4273-bf23-68001a8aa6d5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:02.463356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698705b-e588-40a0-ba0a-13c10389d9a6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-70e9d686-9d1c-4273-bf23-68001a8aa6d5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:02.465413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:02.466903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 09:14:02.467784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:02.475063 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 461/917] 10.222.0.55 () {56 vars in 1132 bytes} [Fri Sep 2 09:14:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:02.476678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9d686-9d1c-4273-bf23-68001a8aa6d5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:02.500914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aad0d5-a751-4a42-8da3-765cef35d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:02.501633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad0d5-a751-4a42-8da3-765cef35d385 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.501912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad0d5-a751-4a42-8da3-765cef35d385 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.502187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad0d5-a751-4a42-8da3-765cef35d385 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.502825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aad0d5-a751-4a42-8da3-765cef35d385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:02.503124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aad0d5-a751-4a42-8da3-765cef35d385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:02.504744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aad0d5-a751-4a42-8da3-765cef35d385 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:02.518867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 457/918] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:02.520329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff3161-a4fd-49fd-a970-45a11d844fe8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.520729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff3161-a4fd-49fd-a970-45a11d844fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.521362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff3161-a4fd-49fd-a970-45a11d844fe8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.522639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 458/919] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:02.523673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff3161-a4fd-49fd-a970-45a11d844fe8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:02.579227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:02.585132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9d686-9d1c-4273-bf23-68001a8aa6d5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:02.622275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d604a-85ed-4eef-ad74-df754f5c3990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:02.622887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d604a-85ed-4eef-ad74-df754f5c3990 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.623192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d604a-85ed-4eef-ad74-df754f5c3990 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.623438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d604a-85ed-4eef-ad74-df754f5c3990 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.624119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d604a-85ed-4eef-ad74-df754f5c3990 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:02.624413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d604a-85ed-4eef-ad74-df754f5c3990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:02.625770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d604a-85ed-4eef-ad74-df754f5c3990 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:02.630721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 462/920] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:14:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:02.635530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205639-5160-4033-9e02-aaa3e652ad0b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.635530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205639-5160-4033-9e02-aaa3e652ad0b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.635530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205639-5160-4033-9e02-aaa3e652ad0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.636557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff3161-a4fd-49fd-a970-45a11d844fe8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:02.652316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c5205639-5160-4033-9e02-aaa3e652ad0b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:02.654147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c5205639-5160-4033-9e02-aaa3e652ad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:02.673480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b067cae-6168-4358-81f3-07834d8e7478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:02.674274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067cae-6168-4358-81f3-07834d8e7478 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.674587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067cae-6168-4358-81f3-07834d8e7478 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.674820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067cae-6168-4358-81f3-07834d8e7478 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.682407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b067cae-6168-4358-81f3-07834d8e7478 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:02.684137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b067cae-6168-4358-81f3-07834d8e7478 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-0b067cae-6168-4358-81f3-07834d8e7478 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:14:02.696222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:02.697166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:02.698145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:02.698145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:02.698145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:14:02.698145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:14:02.698145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:14:02.698145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:14:02.698145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:14:02.698145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:14:02.698145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:14:02.698145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:02.698675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:02.698749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 459/921] 10.222.0.55 () {56 vars in 1117 bytes} [Fri Sep 2 09:14:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:02.699328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b067cae-6168-4358-81f3-07834d8e7478 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:02.731742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 463/922] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:02.732966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5205639-5160-4033-9e02-aaa3e652ad0b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:02.809733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b067cae-6168-4358-81f3-07834d8e7478 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:02.824308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:02.857092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ab27c-ff63-4240-ad6f-cb4ad8426607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:02.857956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ab27c-ff63-4240-ad6f-cb4ad8426607 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.858423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ab27c-ff63-4240-ad6f-cb4ad8426607 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.858901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ab27c-ff63-4240-ad6f-cb4ad8426607 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.859736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ab27c-ff63-4240-ad6f-cb4ad8426607 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:02.860271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ab27c-ff63-4240-ad6f-cb4ad8426607 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:02.861859 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ab27c-ff63-4240-ad6f-cb4ad8426607 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:02.867431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 460/923] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:14:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:02.879941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16ae7-9763-44d5-ab16-774c7e58de81 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.879941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16ae7-9763-44d5-ab16-774c7e58de81 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.879941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16ae7-9763-44d5-ab16-774c7e58de81 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.880209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5205639-5160-4033-9e02-aaa3e652ad0b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:02.880285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 461/924] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:14:02.880285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e16ae7-9763-44d5-ab16-774c7e58de81 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:02.913994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9710c-9b51-4fbe-92da-14096e9310b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:02.914528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9710c-9b51-4fbe-92da-14096e9310b7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.914801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9710c-9b51-4fbe-92da-14096e9310b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.915068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9710c-9b51-4fbe-92da-14096e9310b7 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.915815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9710c-9b51-4fbe-92da-14096e9310b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:02.916150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9710c-9b51-4fbe-92da-14096e9310b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:02.917574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9710c-9b51-4fbe-92da-14096e9310b7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:02.934247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 464/925] 10.222.0.55 () {56 vars in 1149 bytes} [Fri Sep 2 09:14:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:02.935292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a13bc-037e-42e6-857d-05eb06b96af8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:02.935571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a13bc-037e-42e6-857d-05eb06b96af8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:02.935841 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a13bc-037e-42e6-857d-05eb06b96af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:02.953931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c30a13bc-037e-42e6-857d-05eb06b96af8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:02.955103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c30a13bc-037e-42e6-857d-05eb06b96af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:02.981334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:02.986890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e16ae7-9763-44d5-ab16-774c7e58de81 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:03.021651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdd61b-3733-4546-8364-3f52aebd702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:03.022254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdd61b-3733-4546-8364-3f52aebd702a None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:03.022528 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdd61b-3733-4546-8364-3f52aebd702a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:03.022799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdd61b-3733-4546-8364-3f52aebd702a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:03.023452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdd61b-3733-4546-8364-3f52aebd702a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:03.024576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 465/926] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:03.024852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdd61b-3733-4546-8364-3f52aebd702a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:03.028824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a13bc-037e-42e6-857d-05eb06b96af8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:03.079637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 462/927] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:14:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:03.080832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdd61b-3733-4546-8364-3f52aebd702a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:03.128853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:03.160608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a13bc-037e-42e6-857d-05eb06b96af8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:03.223632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd9249-b495-40af-b3ff-6d5bf7c6be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:03.224408 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd9249-b495-40af-b3ff-6d5bf7c6be92 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:03.224974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd9249-b495-40af-b3ff-6d5bf7c6be92 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:03.224974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd9249-b495-40af-b3ff-6d5bf7c6be92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:03.231597 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdd61b-3733-4546-8364-3f52aebd702a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:03.237838 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd9249-b495-40af-b3ff-6d5bf7c6be92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:03.239739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd9249-b495-40af-b3ff-6d5bf7c6be92 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-afbd9249-b495-40af-b3ff-6d5bf7c6be92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:03.259826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:03.260837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:03.261793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:03.261793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:03.261793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:03.261793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 466/928] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:03.268016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd9249-b495-40af-b3ff-6d5bf7c6be92 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:03.279662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a3998-bded-482f-a836-9ba1bc7535b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:03.282085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a3998-bded-482f-a836-9ba1bc7535b4 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:03.282362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a3998-bded-482f-a836-9ba1bc7535b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:03.282631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a3998-bded-482f-a836-9ba1bc7535b4 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:03.283276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a3998-bded-482f-a836-9ba1bc7535b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:03.284693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a3998-bded-482f-a836-9ba1bc7535b4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:03.288088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:03.371060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 463/929] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:14:03 2022] POST /identity/v3/services => generated 241 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:03.371060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a3998-bded-482f-a836-9ba1bc7535b4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:03.388164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd9249-b495-40af-b3ff-6d5bf7c6be92 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:03.436104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e695ae-d871-4b71-8f27-d4d0ed23e4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:03.437066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e695ae-d871-4b71-8f27-d4d0ed23e4ff None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:03.437482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e695ae-d871-4b71-8f27-d4d0ed23e4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:03.437890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e695ae-d871-4b71-8f27-d4d0ed23e4ff None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:03.438699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e695ae-d871-4b71-8f27-d4d0ed23e4ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:03.439145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e695ae-d871-4b71-8f27-d4d0ed23e4ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:03.440737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e695ae-d871-4b71-8f27-d4d0ed23e4ff None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:03.454526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 467/930] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:03.464019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e695ae-d871-4b71-8f27-d4d0ed23e4ff None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:03.482269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:03.493340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a3998-bded-482f-a836-9ba1bc7535b4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:03.539433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb74c04-c0bf-4180-ac49-a7ece851cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:03.540738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb74c04-c0bf-4180-ac49-a7ece851cc87 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:03.540738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb74c04-c0bf-4180-ac49-a7ece851cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:03.540738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb74c04-c0bf-4180-ac49-a7ece851cc87 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:03.541234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb74c04-c0bf-4180-ac49-a7ece851cc87 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:03.542751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb74c04-c0bf-4180-ac49-a7ece851cc87 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-0fb74c04-c0bf-4180-ac49-a7ece851cc87 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:03.553741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:03.554755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:03.555858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 464/931] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:14:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:03.562527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb74c04-c0bf-4180-ac49-a7ece851cc87 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:03.566315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:03.609501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e695ae-d871-4b71-8f27-d4d0ed23e4ff None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:03.650184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f5d6f-ea03-4dc0-a13e-e0fa7f1db686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:03.651061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5d6f-ea03-4dc0-a13e-e0fa7f1db686 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:03.652152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5d6f-ea03-4dc0-a13e-e0fa7f1db686 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:03.652448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5d6f-ea03-4dc0-a13e-e0fa7f1db686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:03.665073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f5d6f-ea03-4dc0-a13e-e0fa7f1db686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:03.667402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f5d6f-ea03-4dc0-a13e-e0fa7f1db686 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:03.683972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb74c04-c0bf-4180-ac49-a7ece851cc87 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-b72f5d6f-ea03-4dc0-a13e-e0fa7f1db686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:14:03.684612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:03.685972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:03.686862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:14:03.686862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:14:03.686862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:14:03.686862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:14:03.686862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:14:03.686862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:14:03.686862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:03.686862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:03.690029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 468/932] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:14:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:03.695850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f5d6f-ea03-4dc0-a13e-e0fa7f1db686 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:03.734287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a92fcf-e132-4524-8d86-3e607bcc7900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:03.735271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92fcf-e132-4524-8d86-3e607bcc7900 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:03.735753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92fcf-e132-4524-8d86-3e607bcc7900 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:03.736274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92fcf-e132-4524-8d86-3e607bcc7900 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:03.737106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a92fcf-e132-4524-8d86-3e607bcc7900 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:03.737610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a92fcf-e132-4524-8d86-3e607bcc7900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:03.739753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a92fcf-e132-4524-8d86-3e607bcc7900 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:03.747990 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 465/933] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:14:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:03.754548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a92fcf-e132-4524-8d86-3e607bcc7900 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:03.776573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:03.818819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f5d6f-ea03-4dc0-a13e-e0fa7f1db686 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:03.861032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:03.872606 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8941a-63bb-4153-9817-6796964e0448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:03.873672 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8941a-63bb-4153-9817-6796964e0448 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:03.874448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8941a-63bb-4153-9817-6796964e0448 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:03.875034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8941a-63bb-4153-9817-6796964e0448 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:03.876120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8941a-63bb-4153-9817-6796964e0448 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:03.876634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8941a-63bb-4153-9817-6796964e0448 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:03.878991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8941a-63bb-4153-9817-6796964e0448 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:03.880552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a92fcf-e132-4524-8d86-3e607bcc7900 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:03.898659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 469/934] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:14:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:03.900185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8941a-63bb-4153-9817-6796964e0448 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:03.926066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35835490-55d6-47fe-82b0-acc80cea9baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:03.927142 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35835490-55d6-47fe-82b0-acc80cea9baa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:03.927633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35835490-55d6-47fe-82b0-acc80cea9baa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:03.928165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35835490-55d6-47fe-82b0-acc80cea9baa None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:03.928992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35835490-55d6-47fe-82b0-acc80cea9baa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:03.929542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35835490-55d6-47fe-82b0-acc80cea9baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:03.931256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35835490-55d6-47fe-82b0-acc80cea9baa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:03.941852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 466/935] 10.222.0.55 () {56 vars in 1114 bytes} [Fri Sep 2 09:14:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:03.942940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35835490-55d6-47fe-82b0-acc80cea9baa None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:04.014754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8941a-63bb-4153-9817-6796964e0448 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:04.030279 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:04.049187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35835490-55d6-47fe-82b0-acc80cea9baa None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:04.052533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029dab8-f894-42d1-bde7-07a9fd91edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:04.052796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029dab8-f894-42d1-bde7-07a9fd91edf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:04.053216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029dab8-f894-42d1-bde7-07a9fd91edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:04.053632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029dab8-f894-42d1-bde7-07a9fd91edf6 None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/2195f7f3cd1d4f35826282958378c754/roles/ae7422720c0043d0b7f44c53804eac0c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:04.056014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029dab8-f894-42d1-bde7-07a9fd91edf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=2195f7f3cd1d4f35826282958378c754, role_id=ae7422720c0043d0b7f44c53804eac0c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:04.057611 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029dab8-f894-42d1-bde7-07a9fd91edf6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:04.086349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148934d8-fa69-4c87-9ebb-872cc70f1504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:04.086958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148934d8-fa69-4c87-9ebb-872cc70f1504 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:04.087238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148934d8-fa69-4c87-9ebb-872cc70f1504 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:04.087509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148934d8-fa69-4c87-9ebb-872cc70f1504 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:04.088312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148934d8-fa69-4c87-9ebb-872cc70f1504 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:04.089692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148934d8-fa69-4c87-9ebb-872cc70f1504 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:04.151551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 470/936] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:14:03 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/2195f7f3cd1d4f35826282958378c754/roles/ae7422720c0043d0b7f44c53804eac0c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:14:04.178136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 467/937] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:14:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:05.037443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca3de-faa5-4042-861e-33977d128330 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:05.037953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca3de-faa5-4042-861e-33977d128330 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:05.038058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca3de-faa5-4042-861e-33977d128330 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:05.039452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 471/938] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:05.045350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a600-d7d2-4d59-a6b5-dbe511e112a0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:05.046165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a600-d7d2-4d59-a6b5-dbe511e112a0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:05.046631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a600-d7d2-4d59-a6b5-dbe511e112a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:05.067019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f0e8a600-d7d2-4d59-a6b5-dbe511e112a0 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:05.067019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f0e8a600-d7d2-4d59-a6b5-dbe511e112a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:05.142610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 468/939] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:05.351910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91f67d-1187-4f03-81a7-c0858b2965f4 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:05.352286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91f67d-1187-4f03-81a7-c0858b2965f4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:05.352517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91f67d-1187-4f03-81a7-c0858b2965f4 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:05.354154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 472/940] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:05.359837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7a50-a845-4edf-a966-7b43441d39c2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:05.360158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7a50-a845-4edf-a966-7b43441d39c2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:05.360437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7a50-a845-4edf-a966-7b43441d39c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:05.382824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-19db7a50-a845-4edf-a966-7b43441d39c2 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:05.384293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-19db7a50-a845-4edf-a966-7b43441d39c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:05.409869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91f67d-1187-4f03-81a7-c0858b2965f4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:05.446351 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:05.454303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 469/941] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:05.464082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:05.516116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91f67d-1187-4f03-81a7-c0858b2965f4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:05.549792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20318e28-138c-41f0-9dae-db4f64d7769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:05.550665 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318e28-138c-41f0-9dae-db4f64d7769d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:05.551139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318e28-138c-41f0-9dae-db4f64d7769d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:05.551579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318e28-138c-41f0-9dae-db4f64d7769d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:05.552391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20318e28-138c-41f0-9dae-db4f64d7769d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:05.553987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20318e28-138c-41f0-9dae-db4f64d7769d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-20318e28-138c-41f0-9dae-db4f64d7769d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:05.563226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:05.564320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 09:14:05.565178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:05.567497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 473/942] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:14:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:05.573474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db7a50-a845-4edf-a966-7b43441d39c2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:05.676555 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db7a50-a845-4edf-a966-7b43441d39c2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:05.711466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dede2-5453-4aa2-9d26-325b7e9e3d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:05.712427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dede2-5453-4aa2-9d26-325b7e9e3d69 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:05.712878 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dede2-5453-4aa2-9d26-325b7e9e3d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:05.713316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dede2-5453-4aa2-9d26-325b7e9e3d69 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:05.714107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dede2-5453-4aa2-9d26-325b7e9e3d69 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:05.714574 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dede2-5453-4aa2-9d26-325b7e9e3d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:05.716770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dede2-5453-4aa2-9d26-325b7e9e3d69 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:05.722183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 470/943] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:14:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:05.728024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20318e28-138c-41f0-9dae-db4f64d7769d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:05.748364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dede2-5453-4aa2-9d26-325b7e9e3d69 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:05.823336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:05.848464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20318e28-138c-41f0-9dae-db4f64d7769d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:05.864254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:05.877687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dede2-5453-4aa2-9d26-325b7e9e3d69 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:05.890992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ef1e1-02ce-4525-a725-d71fbb15030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:05.891991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ef1e1-02ce-4525-a725-d71fbb15030a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:05.892468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ef1e1-02ce-4525-a725-d71fbb15030a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:05.892958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ef1e1-02ce-4525-a725-d71fbb15030a None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:05.893771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ef1e1-02ce-4525-a725-d71fbb15030a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:05.894589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ef1e1-02ce-4525-a725-d71fbb15030a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:05.896436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ef1e1-02ce-4525-a725-d71fbb15030a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:05.901985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 474/944] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:14:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:05.929453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c431-d28b-474d-a476-175f5251ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:05.930452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c431-d28b-474d-a476-175f5251ccd8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:05.930924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c431-d28b-474d-a476-175f5251ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:05.931388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c431-d28b-474d-a476-175f5251ccd8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:05.932282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2c431-d28b-474d-a476-175f5251ccd8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:05.933918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2c431-d28b-474d-a476-175f5251ccd8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-4ba2c431-d28b-474d-a476-175f5251ccd8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:05.944797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:05.945874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:05.946743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:05.949308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 471/945] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:14:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:05.956067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ef1e1-02ce-4525-a725-d71fbb15030a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:06.068237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ef1e1-02ce-4525-a725-d71fbb15030a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:06.104087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32fc11-0e3f-4a5b-98c2-57bee67a7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:06.105081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32fc11-0e3f-4a5b-98c2-57bee67a7418 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.105081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32fc11-0e3f-4a5b-98c2-57bee67a7418 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.105274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32fc11-0e3f-4a5b-98c2-57bee67a7418 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.105804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32fc11-0e3f-4a5b-98c2-57bee67a7418 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:06.106321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32fc11-0e3f-4a5b-98c2-57bee67a7418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:06.108010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32fc11-0e3f-4a5b-98c2-57bee67a7418 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:06.113205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 475/946] 10.222.0.55 () {56 vars in 1122 bytes} [Fri Sep 2 09:14:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:06.119510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c431-d28b-474d-a476-175f5251ccd8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:06.162514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79483484-4d9c-4ca4-8b47-d87ff8029332 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.162796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79483484-4d9c-4ca4-8b47-d87ff8029332 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.163079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79483484-4d9c-4ca4-8b47-d87ff8029332 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.164914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 476/947] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:06.170254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21bcee-447f-4810-8c4b-270c6e8380ee None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.170531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21bcee-447f-4810-8c4b-270c6e8380ee None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.170806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21bcee-447f-4810-8c4b-270c6e8380ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.189436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1e21bcee-447f-4810-8c4b-270c6e8380ee None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:06.191027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1e21bcee-447f-4810-8c4b-270c6e8380ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:06.224588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c431-d28b-474d-a476-175f5251ccd8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:06.228710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:06.247281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:06.258636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3553c-218f-4e5d-b316-aaa82375c6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:06.259243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3553c-218f-4e5d-b316-aaa82375c6fc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.271989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3553c-218f-4e5d-b316-aaa82375c6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.271989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3553c-218f-4e5d-b316-aaa82375c6fc None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.271989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3553c-218f-4e5d-b316-aaa82375c6fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:06.271989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3553c-218f-4e5d-b316-aaa82375c6fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:06.271989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3553c-218f-4e5d-b316-aaa82375c6fc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:06.272410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 477/948] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:06.272410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6982be-2a4b-46bf-b2e5-670de00dc75e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.272410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6982be-2a4b-46bf-b2e5-670de00dc75e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.272410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6982be-2a4b-46bf-b2e5-670de00dc75e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.272698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 472/949] 10.222.0.55 () {56 vars in 1122 bytes} [Fri Sep 2 09:14:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:06.272780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 478/950] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:06.272876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d11c8-382f-4397-a74a-9ac336341d2a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.272876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d11c8-382f-4397-a74a-9ac336341d2a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.273057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d11c8-382f-4397-a74a-9ac336341d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.277528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6982be-2a4b-46bf-b2e5-670de00dc75e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:06.294010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d01d11c8-382f-4397-a74a-9ac336341d2a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:06.296103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d01d11c8-382f-4397-a74a-9ac336341d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:06.387383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 473/951] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:06.393013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6982be-2a4b-46bf-b2e5-670de00dc75e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:06.435717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b1869-62b6-4974-8134-a44ab0c5a561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:06.436362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b1869-62b6-4974-8134-a44ab0c5a561 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.436634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b1869-62b6-4974-8134-a44ab0c5a561 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.436906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b1869-62b6-4974-8134-a44ab0c5a561 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.437589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b1869-62b6-4974-8134-a44ab0c5a561 None admin] RBAC: Adding query filter params (interface=public, service_id=8d2913dfde72454e811cec87c2fab6d6, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:06.437887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b1869-62b6-4974-8134-a44ab0c5a561 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:06.439246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b1869-62b6-4974-8134-a44ab0c5a561 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:06.444791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 479/952] 10.222.0.55 () {56 vars in 1251 bytes} [Fri Sep 2 09:14:06 2022] GET /identity/v3/endpoints?service_id=8d2913dfde72454e811cec87c2fab6d6&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:06.450176 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d11c8-382f-4397-a74a-9ac336341d2a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:06.537452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b1869-62b6-4974-8134-a44ab0c5a561 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:06.557924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d11c8-382f-4397-a74a-9ac336341d2a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:06.579790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:06.580368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:06.603290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29edc58-7426-4e7e-95a5-044d9979a3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:06.603916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29edc58-7426-4e7e-95a5-044d9979a3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.604520 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29edc58-7426-4e7e-95a5-044d9979a3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.604794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29edc58-7426-4e7e-95a5-044d9979a3d7 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.605406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29edc58-7426-4e7e-95a5-044d9979a3d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:06.607340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29edc58-7426-4e7e-95a5-044d9979a3d7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:06.619972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 474/953] 10.222.0.55 () {56 vars in 1087 bytes} [Fri Sep 2 09:14:06 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:14:06.656813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29edc58-7426-4e7e-95a5-044d9979a3d7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:06.662677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b1869-62b6-4974-8134-a44ab0c5a561 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:06.699305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208eb52e-64ce-4872-9b9e-c65ffbe37072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:06.700951 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eb52e-64ce-4872-9b9e-c65ffbe37072 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.701439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eb52e-64ce-4872-9b9e-c65ffbe37072 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.701930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eb52e-64ce-4872-9b9e-c65ffbe37072 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.713708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208eb52e-64ce-4872-9b9e-c65ffbe37072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-208eb52e-64ce-4872-9b9e-c65ffbe37072 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:06.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:06.720737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:14:06.721586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:06.726363 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 480/954] 10.222.0.55 () {56 vars in 1120 bytes} [Fri Sep 2 09:14:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:06.727430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208eb52e-64ce-4872-9b9e-c65ffbe37072 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:06.795096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29edc58-7426-4e7e-95a5-044d9979a3d7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:06.841669 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:06.842561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.842863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.843268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.843428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:06.843952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:06.846006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:06.849453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: WARNING keystone.server.flask.common [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 02 09:14:06.851388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208eb52e-64ce-4872-9b9e-c65ffbe37072 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:06.893300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd9b33-5f3c-4e84-8553-40b934ddec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:06.893907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd9b33-5f3c-4e84-8553-40b934ddec3f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:06.894177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd9b33-5f3c-4e84-8553-40b934ddec3f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:06.894458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd9b33-5f3c-4e84-8553-40b934ddec3f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:06.895100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd9b33-5f3c-4e84-8553-40b934ddec3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:06.895404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd9b33-5f3c-4e84-8553-40b934ddec3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:06.896277 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.sql.core [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 09:14:06.896277 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 02 09:14:06.896277 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [parameters: {'id': '3b0d58c589f248428297673d8c7e6db4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 02 09:14:06.896277 dv-cinder-850831-3-smb devstack@keystone.service[81572]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81572) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 09:14:06.896795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd9b33-5f3c-4e84-8553-40b934ddec3f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:06.905684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 481/955] 10.222.0.55 () {56 vars in 1115 bytes} [Fri Sep 2 09:14:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:06.910885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd9b33-5f3c-4e84-8553-40b934ddec3f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3b0d58c589f248428297673d8c7e6db4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3b0d58c589f248428297673d8c7e6db4. Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application conn.query(q) Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 09:14:06.916248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application result.read() Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 02 09:14:06.917076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application next(self.gen) Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application yield resource Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application next(self.gen) Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise self.value Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application session.commit() Sep 02 09:14:06.918029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self.session.flush() Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application compat.raise_( Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 09:14:06.919145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 09:14:06.921765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application conn.query(q) Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application result.read() Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 09:14:06.922856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [parameters: {'id': '3b0d58c589f248428297673d8c7e6db4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:06.923917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:06.924996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:06.926117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:06.926117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 02 09:14:06.926117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 02 09:14:06.926117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:06.926117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:06.926117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 02 09:14:06.926117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 02 09:14:06.926117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3b0d58c589f248428297673d8c7e6db4. Sep 02 09:14:06.926117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:06.928729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 475/956] 10.222.0.55 () {60 vars in 1140 bytes} [Fri Sep 2 09:14:06 2022] POST /identity/v3/projects => generated 262 bytes in 272 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:06.934403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:06.974308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:07.046587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd9b33-5f3c-4e84-8553-40b934ddec3f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:07.056977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de0fd3-6ba9-48c7-a682-c5fad43e5cf7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:07.083129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c435e5-0f91-44fd-aed5-cc84254751f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:07.083812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c435e5-0f91-44fd-aed5-cc84254751f5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:07.084248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c435e5-0f91-44fd-aed5-cc84254751f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:07.084615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c435e5-0f91-44fd-aed5-cc84254751f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:07.095765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c435e5-0f91-44fd-aed5-cc84254751f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:07.097266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c435e5-0f91-44fd-aed5-cc84254751f5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:07.111744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39862607-985e-4a84-a727-99e02b13b3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-30c435e5-0f91-44fd-aed5-cc84254751f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:07.112506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:07.113428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:07.114447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:07.114447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:07.114447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:07.114447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 482/957] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:07.115403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39862607-985e-4a84-a727-99e02b13b3df None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:07.115752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39862607-985e-4a84-a727-99e02b13b3df None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:07.116109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39862607-985e-4a84-a727-99e02b13b3df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:07.119314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c435e5-0f91-44fd-aed5-cc84254751f5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:07.125095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39862607-985e-4a84-a727-99e02b13b3df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:07.127453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39862607-985e-4a84-a727-99e02b13b3df None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:07.132213 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-39862607-985e-4a84-a727-99e02b13b3df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:14:07.140415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:07.141456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:07.142524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:14:07.142524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:14:07.142524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:14:07.142524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:14:07.142524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:14:07.142524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:14:07.142524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:07.142524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:07.144791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 476/958] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:07.151203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39862607-985e-4a84-a727-99e02b13b3df None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:07.233158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c435e5-0f91-44fd-aed5-cc84254751f5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:07.268386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048c6f6-0ddd-4fdd-8efc-64aee4041fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:07.269237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c6f6-0ddd-4fdd-8efc-64aee4041fdf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:07.269667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c6f6-0ddd-4fdd-8efc-64aee4041fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:07.270081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c6f6-0ddd-4fdd-8efc-64aee4041fdf None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:07.270845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c6f6-0ddd-4fdd-8efc-64aee4041fdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:07.271284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c6f6-0ddd-4fdd-8efc-64aee4041fdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:07.272846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c6f6-0ddd-4fdd-8efc-64aee4041fdf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:07.276306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:07.284653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39862607-985e-4a84-a727-99e02b13b3df None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:07.286447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 483/959] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:07.291549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048c6f6-0ddd-4fdd-8efc-64aee4041fdf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:07.326048 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a9218-e2bb-416c-abb2-b249fedb03bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:07.327078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a9218-e2bb-416c-abb2-b249fedb03bb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:07.327677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a9218-e2bb-416c-abb2-b249fedb03bb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:07.328099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a9218-e2bb-416c-abb2-b249fedb03bb None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:07.329034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a9218-e2bb-416c-abb2-b249fedb03bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:07.329438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a9218-e2bb-416c-abb2-b249fedb03bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:07.331622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a9218-e2bb-416c-abb2-b249fedb03bb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:07.359967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 477/960] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:14:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:07.377739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:07.417479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048c6f6-0ddd-4fdd-8efc-64aee4041fdf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:07.456891 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36430aa2-8cd9-43ed-a48a-200ecb89e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:07.457790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36430aa2-8cd9-43ed-a48a-200ecb89e514 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:07.458247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36430aa2-8cd9-43ed-a48a-200ecb89e514 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:07.458660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36430aa2-8cd9-43ed-a48a-200ecb89e514 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:07.467712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36430aa2-8cd9-43ed-a48a-200ecb89e514 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:07.469485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36430aa2-8cd9-43ed-a48a-200ecb89e514 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-36430aa2-8cd9-43ed-a48a-200ecb89e514 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:14:07.482843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:07.484147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:07.485306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:07.485306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:07.485306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:14:07.485306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:14:07.485306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:14:07.485306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:14:07.485306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:14:07.485306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:14:07.485306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 09:14:07.485306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:07.487663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 484/961] 10.222.0.55 () {56 vars in 1117 bytes} [Fri Sep 2 09:14:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:07.493317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a9218-e2bb-416c-abb2-b249fedb03bb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:07.603354 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a9218-e2bb-416c-abb2-b249fedb03bb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:07.640028 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c3422-85af-409c-a399-57a43d50e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:07.640818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3422-85af-409c-a399-57a43d50e819 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:07.641191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3422-85af-409c-a399-57a43d50e819 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:07.641592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3422-85af-409c-a399-57a43d50e819 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:07.642452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c3422-85af-409c-a399-57a43d50e819 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:07.642856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c3422-85af-409c-a399-57a43d50e819 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:07.644423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c3422-85af-409c-a399-57a43d50e819 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:07.663393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 478/962] 10.222.0.55 () {56 vars in 1149 bytes} [Fri Sep 2 09:14:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:07.669473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36430aa2-8cd9-43ed-a48a-200ecb89e514 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:07.771615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36430aa2-8cd9-43ed-a48a-200ecb89e514 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:07.799488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:07.807328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7274a5-1a51-4b6f-9e36-a115193e8f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:07.807968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7274a5-1a51-4b6f-9e36-a115193e8f01 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:07.808250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7274a5-1a51-4b6f-9e36-a115193e8f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:07.808524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7274a5-1a51-4b6f-9e36-a115193e8f01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:07.894792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7274a5-1a51-4b6f-9e36-a115193e8f01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:07.896339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7274a5-1a51-4b6f-9e36-a115193e8f01 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:07.904787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d2fd2-63a1-4fdd-ad24-52c633f5b69c None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:07.905071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d2fd2-63a1-4fdd-ad24-52c633f5b69c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:07.905342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d2fd2-63a1-4fdd-ad24-52c633f5b69c None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:07.906904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 479/963] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:07.912051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0df4ed-277f-4871-99f4-ab6f6430bf9d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:07.912335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0df4ed-277f-4871-99f4-ab6f6430bf9d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:07.912609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0df4ed-277f-4871-99f4-ab6f6430bf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:07.932685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-0f0df4ed-277f-4871-99f4-ab6f6430bf9d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:07.934457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0f0df4ed-277f-4871-99f4-ab6f6430bf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:07.946425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:08.024871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 485/964] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:07 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:14:08.028018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 480/965] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:08.030283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7274a5-1a51-4b6f-9e36-a115193e8f01 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:08.057189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:08.129998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7274a5-1a51-4b6f-9e36-a115193e8f01 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:08.166508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05263e3d-a037-4c6a-8109-c5f950fcf844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:08.167373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05263e3d-a037-4c6a-8109-c5f950fcf844 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:08.167794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05263e3d-a037-4c6a-8109-c5f950fcf844 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:08.168234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05263e3d-a037-4c6a-8109-c5f950fcf844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:08.178600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05263e3d-a037-4c6a-8109-c5f950fcf844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:08.180350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05263e3d-a037-4c6a-8109-c5f950fcf844 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-05263e3d-a037-4c6a-8109-c5f950fcf844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:08.195283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:08.196497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:08.197618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:08.197618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:08.197618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:08.199292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 486/966] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:08.205587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0df4ed-277f-4871-99f4-ab6f6430bf9d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:08.314474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0df4ed-277f-4871-99f4-ab6f6430bf9d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:08.339277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05263e3d-a037-4c6a-8109-c5f950fcf844 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:08.351533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c9683-93a2-4bc2-87f5-cec7cf000afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:08.356287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c9683-93a2-4bc2-87f5-cec7cf000afb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:08.356287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c9683-93a2-4bc2-87f5-cec7cf000afb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:08.356287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c9683-93a2-4bc2-87f5-cec7cf000afb None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:08.356287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c9683-93a2-4bc2-87f5-cec7cf000afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:08.356287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c9683-93a2-4bc2-87f5-cec7cf000afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:08.356287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c9683-93a2-4bc2-87f5-cec7cf000afb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:08.371943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 481/967] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:08.377736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c9683-93a2-4bc2-87f5-cec7cf000afb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:08.382437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:08.442541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:08.465979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05263e3d-a037-4c6a-8109-c5f950fcf844 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:08.500468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c9683-93a2-4bc2-87f5-cec7cf000afb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:08.511865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493362b2-7016-48c9-8461-5aba0fcc79bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:08.513556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493362b2-7016-48c9-8461-5aba0fcc79bc None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:08.513984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493362b2-7016-48c9-8461-5aba0fcc79bc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:08.514565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493362b2-7016-48c9-8461-5aba0fcc79bc None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:08.515778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493362b2-7016-48c9-8461-5aba0fcc79bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:08.517599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493362b2-7016-48c9-8461-5aba0fcc79bc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:08.536329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd353b11-1435-48a0-b837-6d2d91d2ae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:08.536949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353b11-1435-48a0-b837-6d2d91d2ae86 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:08.537223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353b11-1435-48a0-b837-6d2d91d2ae86 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:08.539459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353b11-1435-48a0-b837-6d2d91d2ae86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:08.544272 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd353b11-1435-48a0-b837-6d2d91d2ae86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:08.546216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd353b11-1435-48a0-b837-6d2d91d2ae86 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-cd353b11-1435-48a0-b837-6d2d91d2ae86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:14:08.557535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:08.558598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:08.559686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:14:08.559686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:14:08.559686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:14:08.559686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:14:08.559686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:14:08.559686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:14:08.559686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:08.559686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:08.563590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 482/968] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:08.564452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd353b11-1435-48a0-b837-6d2d91d2ae86 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:08.611994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 487/969] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:14:08 2022] POST /identity/v3/services => generated 242 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:08.645607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:08.691896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd353b11-1435-48a0-b837-6d2d91d2ae86 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:08.718925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5581b7d-6796-4044-ac5a-03d304625ebc None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:08.719245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5581b7d-6796-4044-ac5a-03d304625ebc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:08.719473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5581b7d-6796-4044-ac5a-03d304625ebc None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:08.724979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 488/970] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:14:08.726818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd52a1-3fce-43ae-8382-24a5f3d4f7fc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:08.727103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd52a1-3fce-43ae-8382-24a5f3d4f7fc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:08.727373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd52a1-3fce-43ae-8382-24a5f3d4f7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:08.738665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c0b80-5321-419e-a3b2-9693f51e9289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:08.739280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c0b80-5321-419e-a3b2-9693f51e9289 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:08.739550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c0b80-5321-419e-a3b2-9693f51e9289 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:08.739814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c0b80-5321-419e-a3b2-9693f51e9289 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:08.741232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c0b80-5321-419e-a3b2-9693f51e9289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:08.741535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c0b80-5321-419e-a3b2-9693f51e9289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:08.743357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c0b80-5321-419e-a3b2-9693f51e9289 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:08.746656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-41cd52a1-3fce-43ae-8382-24a5f3d4f7fc None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:08.747943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-41cd52a1-3fce-43ae-8382-24a5f3d4f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:08.758785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 483/971] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:08.765173 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c0b80-5321-419e-a3b2-9693f51e9289 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:08.835780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 489/972] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:08.886694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c0b80-5321-419e-a3b2-9693f51e9289 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:08.908877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:08.923351 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f311b50-7caf-4f9b-8ef5-4b6dee2c49fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:08.926542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f311b50-7caf-4f9b-8ef5-4b6dee2c49fe None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:08.926542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f311b50-7caf-4f9b-8ef5-4b6dee2c49fe None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:08.926542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f311b50-7caf-4f9b-8ef5-4b6dee2c49fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:08.926542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f311b50-7caf-4f9b-8ef5-4b6dee2c49fe None admin] RBAC: Adding query filter params (role.id=ae7422720c0043d0b7f44c53804eac0c, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=2195f7f3cd1d4f35826282958378c754) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:08.926542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f311b50-7caf-4f9b-8ef5-4b6dee2c49fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:08.927056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f311b50-7caf-4f9b-8ef5-4b6dee2c49fe None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:08.933364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 484/973] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:14:08 2022] GET /identity/v3/role_assignments?user.id=2195f7f3cd1d4f35826282958378c754&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=ae7422720c0043d0b7f44c53804eac0c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:09.111660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd52a1-3fce-43ae-8382-24a5f3d4f7fc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:09.190131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:09.221368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd52a1-3fce-43ae-8382-24a5f3d4f7fc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:09.257758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07e8fe-4285-4361-b03a-5cdd6e52edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:09.258402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07e8fe-4285-4361-b03a-5cdd6e52edc6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:09.258682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07e8fe-4285-4361-b03a-5cdd6e52edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:09.258957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07e8fe-4285-4361-b03a-5cdd6e52edc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:09.259667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07e8fe-4285-4361-b03a-5cdd6e52edc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:09.261129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07e8fe-4285-4361-b03a-5cdd6e52edc6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2f07e8fe-4285-4361-b03a-5cdd6e52edc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:09.270697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:09.271746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:09.272961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 490/974] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:14:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:09.277754 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f311b50-7caf-4f9b-8ef5-4b6dee2c49fe None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:09.384325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f311b50-7caf-4f9b-8ef5-4b6dee2c49fe None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:09.418030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd74b2-4136-4c2c-bb4c-f74724f1cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:09.418642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd74b2-4136-4c2c-bb4c-f74724f1cb1b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:09.418911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd74b2-4136-4c2c-bb4c-f74724f1cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:09.419180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd74b2-4136-4c2c-bb4c-f74724f1cb1b None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:09.420355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd74b2-4136-4c2c-bb4c-f74724f1cb1b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:09.420650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd74b2-4136-4c2c-bb4c-f74724f1cb1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:09.422076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd74b2-4136-4c2c-bb4c-f74724f1cb1b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:09.427589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 485/975] 10.222.0.55 () {56 vars in 1122 bytes} [Fri Sep 2 09:14:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:09.433101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07e8fe-4285-4361-b03a-5cdd6e52edc6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:09.463861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218a966-166f-44d5-b87f-7955710b22d9 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:09.464180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218a966-166f-44d5-b87f-7955710b22d9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:09.464341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218a966-166f-44d5-b87f-7955710b22d9 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:09.466168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 486/976] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:09.471090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a95f-9d9e-45d1-b879-1dfb41f99690 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:09.471365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a95f-9d9e-45d1-b879-1dfb41f99690 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:09.471632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a95f-9d9e-45d1-b879-1dfb41f99690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:09.491040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4b47a95f-9d9e-45d1-b879-1dfb41f99690 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:09.492363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4b47a95f-9d9e-45d1-b879-1dfb41f99690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:09.539797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:09.543198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07e8fe-4285-4361-b03a-5cdd6e52edc6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:09.572349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 487/977] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:09.580778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4995-6f63-4098-b3ef-c885e487b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:09.581622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4995-6f63-4098-b3ef-c885e487b908 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:09.582042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4995-6f63-4098-b3ef-c885e487b908 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:09.582515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4995-6f63-4098-b3ef-c885e487b908 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:09.583274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f4995-6f63-4098-b3ef-c885e487b908 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:09.583757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f4995-6f63-4098-b3ef-c885e487b908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:09.585337 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f4995-6f63-4098-b3ef-c885e487b908 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:09.586770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:09.591362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 491/978] 10.222.0.55 () {56 vars in 1122 bytes} [Fri Sep 2 09:14:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:09.597273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47a95f-9d9e-45d1-b879-1dfb41f99690 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:09.706113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47a95f-9d9e-45d1-b879-1dfb41f99690 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:09.743244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f40f1-2d6f-4301-888d-6987077d1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:09.743505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f40f1-2d6f-4301-888d-6987077d1b19 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:09.743808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f40f1-2d6f-4301-888d-6987077d1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:09.744016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f40f1-2d6f-4301-888d-6987077d1b19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:09.744676 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f40f1-2d6f-4301-888d-6987077d1b19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:09.746407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f40f1-2d6f-4301-888d-6987077d1b19 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:09.852800 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4995-6f63-4098-b3ef-c885e487b908 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:09.873304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 488/979] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:14:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:09.971784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4995-6f63-4098-b3ef-c885e487b908 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:10.014862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:10.015397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:10.015672 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:10.015964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:10.016617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:10.018175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:10.020926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WARNING keystone.server.flask.common [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 02 09:14:10.067815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.sql.core [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 09:14:10.067815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 02 09:14:10.067815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [parameters: {'user_id': 'db85fd54616b47cbaac8e76f2e784e96', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 02 09:14:10.067815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81573) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Sep 02 09:14:10.075321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 09:14:10.082162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application yield resource Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise self.value Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application session.commit() Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 09:14:10.083182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.flush() Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application compat.raise_( Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 09:14:10.085405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 09:14:10.086317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 09:14:10.087198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [parameters: {'user_id': 'db85fd54616b47cbaac8e76f2e784e96', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:10.088823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 02 09:14:10.089941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 02 09:14:10.091763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 02 09:14:10.091763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 02 09:14:10.091763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 09:14:10.091763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 09:14:10.091763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 02 09:14:10.091763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:10.091763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 492/980] 10.222.0.55 () {60 vars in 1131 bytes} [Fri Sep 2 09:14:09 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:10.092300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f40f1-2d6f-4301-888d-6987077d1b19 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:10.128423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:10.194639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f40f1-2d6f-4301-888d-6987077d1b19 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:10.229983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c16b65-259d-4631-ac71-3324b14bd9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:10.230610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c16b65-259d-4631-ac71-3324b14bd9cc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:10.230884 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c16b65-259d-4631-ac71-3324b14bd9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:10.231152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c16b65-259d-4631-ac71-3324b14bd9cc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:10.238815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c16b65-259d-4631-ac71-3324b14bd9cc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:10.240290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c16b65-259d-4631-ac71-3324b14bd9cc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-23c16b65-259d-4631-ac71-3324b14bd9cc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:14:10.251687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:10.252651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:10.253630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 489/981] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:14:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:10.259081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:10.317667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:10.362683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f5bad-f46e-4f4d-a17d-4d6a6d4a4baa None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:10.396883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf221e2-ad3b-4ca1-98e7-723252cc484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:10.397487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf221e2-ad3b-4ca1-98e7-723252cc484f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:10.397758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf221e2-ad3b-4ca1-98e7-723252cc484f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:10.398026 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf221e2-ad3b-4ca1-98e7-723252cc484f None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:10.398711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf221e2-ad3b-4ca1-98e7-723252cc484f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:10.399003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf221e2-ad3b-4ca1-98e7-723252cc484f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:10.400669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf221e2-ad3b-4ca1-98e7-723252cc484f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:10.444072 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 493/982] 10.222.0.55 () {56 vars in 1101 bytes} [Fri Sep 2 09:14:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:10.678257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5cae5-b2ec-4939-af00-dc7be0d86db3 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:10.678894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5cae5-b2ec-4939-af00-dc7be0d86db3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:10.678894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5cae5-b2ec-4939-af00-dc7be0d86db3 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:10.680499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 490/983] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:10.686442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20797c62-5ebf-4010-b818-910c27df69d4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:10.686726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20797c62-5ebf-4010-b818-910c27df69d4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:10.686995 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20797c62-5ebf-4010-b818-910c27df69d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:10.705737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-20797c62-5ebf-4010-b818-910c27df69d4 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:10.707234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-20797c62-5ebf-4010-b818-910c27df69d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:10.773646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 494/984] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:10.930989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a55695-c22a-4f90-82b2-55c2e799630b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:10.931291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a55695-c22a-4f90-82b2-55c2e799630b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:10.931495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a55695-c22a-4f90-82b2-55c2e799630b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:10.932993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 491/985] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:10.938473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2daf65-12cd-4a5f-a5f1-61d60f02ab37 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:10.938766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2daf65-12cd-4a5f-a5f1-61d60f02ab37 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:10.939045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2daf65-12cd-4a5f-a5f1-61d60f02ab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:10.957381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5b2daf65-12cd-4a5f-a5f1-61d60f02ab37 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:10.958634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5b2daf65-12cd-4a5f-a5f1-61d60f02ab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:10.999240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:11.025355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 495/986] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:11.055530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a55695-c22a-4f90-82b2-55c2e799630b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:11.151738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:11.159701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a55695-c22a-4f90-82b2-55c2e799630b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:11.193745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e6856-e016-4304-a392-106f18e1692e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:11.194301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e6856-e016-4304-a392-106f18e1692e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:11.194578 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e6856-e016-4304-a392-106f18e1692e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:11.194848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e6856-e016-4304-a392-106f18e1692e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:11.195415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e6856-e016-4304-a392-106f18e1692e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:11.196805 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e6856-e016-4304-a392-106f18e1692e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-226e6856-e016-4304-a392-106f18e1692e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:11.205504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:11.206544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:11.209036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 492/987] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:14:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:11.212657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2daf65-12cd-4a5f-a5f1-61d60f02ab37 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:11.290506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e6856-e016-4304-a392-106f18e1692e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:11.318111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2daf65-12cd-4a5f-a5f1-61d60f02ab37 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:11.358516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f53294-0643-4ab4-979f-5bee9d365462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:11.359120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f53294-0643-4ab4-979f-5bee9d365462 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:11.359390 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f53294-0643-4ab4-979f-5bee9d365462 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:11.359655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f53294-0643-4ab4-979f-5bee9d365462 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:11.360311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f53294-0643-4ab4-979f-5bee9d365462 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:11.360604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f53294-0643-4ab4-979f-5bee9d365462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:11.361960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f53294-0643-4ab4-979f-5bee9d365462 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:11.371480 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 496/988] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:14:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:11.372812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f53294-0643-4ab4-979f-5bee9d365462 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:11.402103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e6856-e016-4304-a392-106f18e1692e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:11.412378 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:11.440513 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98bbe0-28d2-420b-aaca-97172f2e495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:11.441135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98bbe0-28d2-420b-aaca-97172f2e495f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:11.441408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98bbe0-28d2-420b-aaca-97172f2e495f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:11.441811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98bbe0-28d2-420b-aaca-97172f2e495f None admin] PATH_INFO: `/v3/services/image` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:11.442296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98bbe0-28d2-420b-aaca-97172f2e495f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:11.443719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98bbe0-28d2-420b-aaca-97172f2e495f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-fe98bbe0-28d2-420b-aaca-97172f2e495f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:11.452962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:11.453947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:11.454798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 493/989] 10.222.0.55 () {56 vars in 1105 bytes} [Fri Sep 2 09:14:11 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:11.459775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98bbe0-28d2-420b-aaca-97172f2e495f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:11.483063 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f53294-0643-4ab4-979f-5bee9d365462 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:11.486356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:11.518895 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa215c1-2c47-4376-92a2-e05acf7b5851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:11.519504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa215c1-2c47-4376-92a2-e05acf7b5851 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:11.519782 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa215c1-2c47-4376-92a2-e05acf7b5851 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:11.520088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa215c1-2c47-4376-92a2-e05acf7b5851 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:11.520711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa215c1-2c47-4376-92a2-e05acf7b5851 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:11.521013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa215c1-2c47-4376-92a2-e05acf7b5851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:11.522366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa215c1-2c47-4376-92a2-e05acf7b5851 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:11.527349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 497/990] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:14:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:11.533444 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa215c1-2c47-4376-92a2-e05acf7b5851 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:11.565542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98bbe0-28d2-420b-aaca-97172f2e495f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:11.602570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4375a6-ecfc-4050-9071-4f2e2a56ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:11.603212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4375a6-ecfc-4050-9071-4f2e2a56ec01 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:11.603453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4375a6-ecfc-4050-9071-4f2e2a56ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:11.603735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4375a6-ecfc-4050-9071-4f2e2a56ec01 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:11.604389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4375a6-ecfc-4050-9071-4f2e2a56ec01 None admin] RBAC: Adding query filter params (name=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:11.604687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4375a6-ecfc-4050-9071-4f2e2a56ec01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:11.606315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4375a6-ecfc-4050-9071-4f2e2a56ec01 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:11.611592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 494/991] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:11.617027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4375a6-ecfc-4050-9071-4f2e2a56ec01 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:11.640675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa215c1-2c47-4376-92a2-e05acf7b5851 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:11.642203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:11.677283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9038b-19b6-464b-96c1-1948e19b3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:11.678040 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9038b-19b6-464b-96c1-1948e19b3ced None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:11.678414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9038b-19b6-464b-96c1-1948e19b3ced None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:11.678787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9038b-19b6-464b-96c1-1948e19b3ced None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:11.679596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9038b-19b6-464b-96c1-1948e19b3ced None admin] RBAC: Adding query filter params (interface=public, service_id=16ba5430ae3c495db8e36444cfc36c2e, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:11.680045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9038b-19b6-464b-96c1-1948e19b3ced None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:11.681412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9038b-19b6-464b-96c1-1948e19b3ced None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:11.687587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 498/992] 10.222.0.55 () {56 vars in 1251 bytes} [Fri Sep 2 09:14:11 2022] GET /identity/v3/endpoints?service_id=16ba5430ae3c495db8e36444cfc36c2e&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:11.692795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9038b-19b6-464b-96c1-1948e19b3ced None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:11.707966 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:11.723172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4375a6-ecfc-4050-9071-4f2e2a56ec01 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:11.761041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d884d-0337-41ee-b675-b4e21e3b08cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:11.761849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d884d-0337-41ee-b675-b4e21e3b08cf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:11.762193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d884d-0337-41ee-b675-b4e21e3b08cf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:11.762823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d884d-0337-41ee-b675-b4e21e3b08cf None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:11.763656 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d884d-0337-41ee-b675-b4e21e3b08cf None admin] RBAC: Adding query filter params (type=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:11.764078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d884d-0337-41ee-b675-b4e21e3b08cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:11.765911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d884d-0337-41ee-b675-b4e21e3b08cf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:11.770531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 495/993] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:11.803060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9038b-19b6-464b-96c1-1948e19b3ced None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:11.848599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aaca3a-7412-4bf4-9b06-da3c56892142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:11.849510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaca3a-7412-4bf4-9b06-da3c56892142 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:11.849930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaca3a-7412-4bf4-9b06-da3c56892142 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:11.850368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaca3a-7412-4bf4-9b06-da3c56892142 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:11.851131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aaca3a-7412-4bf4-9b06-da3c56892142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:11.852691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aaca3a-7412-4bf4-9b06-da3c56892142 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:11.860534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 499/994] 10.222.0.55 () {56 vars in 1087 bytes} [Fri Sep 2 09:14:11 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:14:11.920949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b1be-2a23-4640-bb8f-eaeea2dc719b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:11.921221 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b1be-2a23-4640-bb8f-eaeea2dc719b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:11.921498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b1be-2a23-4640-bb8f-eaeea2dc719b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:11.922862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 496/995] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:11.928842 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8a09-b6eb-440e-b933-3a63c3a30edb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:11.929264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8a09-b6eb-440e-b933-3a63c3a30edb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:11.929640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8a09-b6eb-440e-b933-3a63c3a30edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:11.949729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b27e8a09-b6eb-440e-b933-3a63c3a30edb None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:11.951162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b27e8a09-b6eb-440e-b933-3a63c3a30edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:11.978061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:12.026900 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 500/996] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:12.301364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b1be-2a23-4640-bb8f-eaeea2dc719b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:12.414631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b1be-2a23-4640-bb8f-eaeea2dc719b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:12.455229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdefe6-a0de-4ac8-8e69-9b9484666ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:12.455870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdefe6-a0de-4ac8-8e69-9b9484666ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:12.456187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdefe6-a0de-4ac8-8e69-9b9484666ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:12.456459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdefe6-a0de-4ac8-8e69-9b9484666ae1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:12.457039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdefe6-a0de-4ac8-8e69-9b9484666ae1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:12.458435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdefe6-a0de-4ac8-8e69-9b9484666ae1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-eafdefe6-a0de-4ac8-8e69-9b9484666ae1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:12.468281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:12.469249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:12.470121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 497/997] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:14:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:12.475919 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e8a09-b6eb-440e-b933-3a63c3a30edb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:12.577709 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e8a09-b6eb-440e-b933-3a63c3a30edb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:12.614240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfb15f-d15f-487b-8638-41e43fc665f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:12.614858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfb15f-d15f-487b-8638-41e43fc665f1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:12.615138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfb15f-d15f-487b-8638-41e43fc665f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:12.615413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfb15f-d15f-487b-8638-41e43fc665f1 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:12.616396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfb15f-d15f-487b-8638-41e43fc665f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:12.616703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfb15f-d15f-487b-8638-41e43fc665f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:12.618451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfb15f-d15f-487b-8638-41e43fc665f1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:12.629716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 501/998] 10.222.0.55 () {56 vars in 1122 bytes} [Fri Sep 2 09:14:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:12.631414 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdefe6-a0de-4ac8-8e69-9b9484666ae1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:12.651041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:12.736176 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdefe6-a0de-4ac8-8e69-9b9484666ae1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:12.770822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b620846-dca0-4b81-835f-e834bb5600f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:12.771428 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b620846-dca0-4b81-835f-e834bb5600f7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:12.771706 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b620846-dca0-4b81-835f-e834bb5600f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:12.772017 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b620846-dca0-4b81-835f-e834bb5600f7 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:12.772648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b620846-dca0-4b81-835f-e834bb5600f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:12.772951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b620846-dca0-4b81-835f-e834bb5600f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:12.774326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b620846-dca0-4b81-835f-e834bb5600f7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:12.779388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 498/999] 10.222.0.55 () {56 vars in 1122 bytes} [Fri Sep 2 09:14:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:12.785145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfb15f-d15f-487b-8638-41e43fc665f1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:12.810910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:12.896756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfb15f-d15f-487b-8638-41e43fc665f1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:12.930163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0f13d-b3e9-4338-acdf-4592a6786b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:12.930772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0f13d-b3e9-4338-acdf-4592a6786b07 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:12.931048 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0f13d-b3e9-4338-acdf-4592a6786b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:12.931318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0f13d-b3e9-4338-acdf-4592a6786b07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:12.932051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0f13d-b3e9-4338-acdf-4592a6786b07 None admin] RBAC: Adding query filter params (interface=admin, service_id=8d2913dfde72454e811cec87c2fab6d6, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:12.932635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0f13d-b3e9-4338-acdf-4592a6786b07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:12.933998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0f13d-b3e9-4338-acdf-4592a6786b07 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:12.939660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 502/1000] 10.222.0.55 () {56 vars in 1249 bytes} [Fri Sep 2 09:14:12 2022] GET /identity/v3/endpoints?service_id=8d2913dfde72454e811cec87c2fab6d6&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:12.945101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b620846-dca0-4b81-835f-e834bb5600f7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:13.026754 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:13.048071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b620846-dca0-4b81-835f-e834bb5600f7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:13.081236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb712e77-d61b-4d37-89e9-a5c893bcee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:13.082020 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb712e77-d61b-4d37-89e9-a5c893bcee24 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:13.082441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb712e77-d61b-4d37-89e9-a5c893bcee24 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:13.082882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb712e77-d61b-4d37-89e9-a5c893bcee24 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:13.083632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb712e77-d61b-4d37-89e9-a5c893bcee24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:13.085167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb712e77-d61b-4d37-89e9-a5c893bcee24 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:13.091761 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 499/1001] 10.222.0.55 () {56 vars in 1087 bytes} [Fri Sep 2 09:14:12 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:14:13.708756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2512019-2ab7-4e6a-aed0-2dfd29671007 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:13.709298 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2512019-2ab7-4e6a-aed0-2dfd29671007 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:13.709298 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2512019-2ab7-4e6a-aed0-2dfd29671007 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:13.710786 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 503/1002] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:13.715776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a13444-1ba9-4d56-8106-5bd6335891d6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:13.716102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a13444-1ba9-4d56-8106-5bd6335891d6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:13.716930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a13444-1ba9-4d56-8106-5bd6335891d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:13.735542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-73a13444-1ba9-4d56-8106-5bd6335891d6 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:13.736754 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-73a13444-1ba9-4d56-8106-5bd6335891d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:13.804469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 500/1003] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:13.825338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b20e-97fe-4b80-ab3c-bfcfb66e684c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:13.825651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b20e-97fe-4b80-ab3c-bfcfb66e684c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:13.825983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b20e-97fe-4b80-ab3c-bfcfb66e684c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:13.827463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 504/1004] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:13.832611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a36d-4ad3-4a90-9d74-aa504215ecdd None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:13.832897 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a36d-4ad3-4a90-9d74-aa504215ecdd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:13.833171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a36d-4ad3-4a90-9d74-aa504215ecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:13.854563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-9765a36d-4ad3-4a90-9d74-aa504215ecdd None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:13.855737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9765a36d-4ad3-4a90-9d74-aa504215ecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:13.924007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 501/1005] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:14.078842 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b20e-97fe-4b80-ab3c-bfcfb66e684c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:14.173803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:14.188248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b20e-97fe-4b80-ab3c-bfcfb66e684c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:14.204448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a36d-4ad3-4a90-9d74-aa504215ecdd None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:14.206907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:14.224443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b1b28-4c2c-4797-ad22-4c196fb9fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:14.225049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1b28-4c2c-4797-ad22-4c196fb9fe9f None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:14.225321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1b28-4c2c-4797-ad22-4c196fb9fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:14.225618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1b28-4c2c-4797-ad22-4c196fb9fe9f None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:14.226304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b1b28-4c2c-4797-ad22-4c196fb9fe9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:14.228345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b1b28-4c2c-4797-ad22-4c196fb9fe9f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:14.306441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a36d-4ad3-4a90-9d74-aa504215ecdd None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:14.331999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 505/1006] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:14:14 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:14.352348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e0d1b-a380-42f1-b708-e3d513e9337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:14.352996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e0d1b-a380-42f1-b708-e3d513e9337e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:14.353270 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e0d1b-a380-42f1-b708-e3d513e9337e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:14.353537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e0d1b-a380-42f1-b708-e3d513e9337e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:14.354125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e0d1b-a380-42f1-b708-e3d513e9337e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:14.355557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e0d1b-a380-42f1-b708-e3d513e9337e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b05e0d1b-a380-42f1-b708-e3d513e9337e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:14.365739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:14.366844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:14.373745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 502/1007] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:14:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:14.374562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b1b28-4c2c-4797-ad22-4c196fb9fe9f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:14.487392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b1b28-4c2c-4797-ad22-4c196fb9fe9f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:14.525288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfb301-984b-4afa-abf1-17dd16caf065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:14.525904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfb301-984b-4afa-abf1-17dd16caf065 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:14.526179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfb301-984b-4afa-abf1-17dd16caf065 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:14.526449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfb301-984b-4afa-abf1-17dd16caf065 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:14.527077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfb301-984b-4afa-abf1-17dd16caf065 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:14.527377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfb301-984b-4afa-abf1-17dd16caf065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:14.528770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfb301-984b-4afa-abf1-17dd16caf065 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:14.533961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 506/1008] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:14:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:14.539863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e0d1b-a380-42f1-b708-e3d513e9337e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:14.603456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:14.643539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e0d1b-a380-42f1-b708-e3d513e9337e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:14.677307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb5bfc-c116-45e6-8bdc-5094cf5dead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:14.677914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb5bfc-c116-45e6-8bdc-5094cf5dead3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:14.678186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb5bfc-c116-45e6-8bdc-5094cf5dead3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:14.678454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb5bfc-c116-45e6-8bdc-5094cf5dead3 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:14.679074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb5bfc-c116-45e6-8bdc-5094cf5dead3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:14.679373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb5bfc-c116-45e6-8bdc-5094cf5dead3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:14.680766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb5bfc-c116-45e6-8bdc-5094cf5dead3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:14.686358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 503/1009] 10.222.0.55 () {56 vars in 1112 bytes} [Fri Sep 2 09:14:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:14.691771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfb301-984b-4afa-abf1-17dd16caf065 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:14.707305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:14.792007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfb301-984b-4afa-abf1-17dd16caf065 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:14.833605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd387ba-e4cb-499c-83f7-87fb37a077bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:14.834225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd387ba-e4cb-499c-83f7-87fb37a077bc None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:14.834502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd387ba-e4cb-499c-83f7-87fb37a077bc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:14.834775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd387ba-e4cb-499c-83f7-87fb37a077bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:14.835920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd387ba-e4cb-499c-83f7-87fb37a077bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:14.838025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd387ba-e4cb-499c-83f7-87fb37a077bc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:14.926611 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 507/1010] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:14:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:15.021197 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735433f-e12e-49af-a916-e1e2276fe666 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:15.021719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735433f-e12e-49af-a916-e1e2276fe666 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:15.021826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735433f-e12e-49af-a916-e1e2276fe666 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:15.023302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 504/1011] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:15.028780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d264a2-0224-4fbc-ba17-97ff75e1e069 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:15.029606 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d264a2-0224-4fbc-ba17-97ff75e1e069 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:15.029886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d264a2-0224-4fbc-ba17-97ff75e1e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:15.048920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-13d264a2-0224-4fbc-ba17-97ff75e1e069 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:15.050154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-13d264a2-0224-4fbc-ba17-97ff75e1e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:15.114524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:15.126377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 508/1012] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:15 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:15.392870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735433f-e12e-49af-a916-e1e2276fe666 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:15.498871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735433f-e12e-49af-a916-e1e2276fe666 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:15.524770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:15.533971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70772af8-bbdc-4656-9e6e-786e8ada0aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:15.534595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772af8-bbdc-4656-9e6e-786e8ada0aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:15.534870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772af8-bbdc-4656-9e6e-786e8ada0aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:15.535138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772af8-bbdc-4656-9e6e-786e8ada0aa4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:15.539473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70772af8-bbdc-4656-9e6e-786e8ada0aa4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:15.539473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70772af8-bbdc-4656-9e6e-786e8ada0aa4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-70772af8-bbdc-4656-9e6e-786e8ada0aa4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:15.546603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:15.547591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 09:14:15.548811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:15.552213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 505/1013] 10.222.0.55 () {56 vars in 1126 bytes} [Fri Sep 2 09:14:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:15.553586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d264a2-0224-4fbc-ba17-97ff75e1e069 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:15.654681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d264a2-0224-4fbc-ba17-97ff75e1e069 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:15.688781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492335c1-4ee1-4a0b-b2a1-ba4a1f3265e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:15.689397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492335c1-4ee1-4a0b-b2a1-ba4a1f3265e7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:15.689672 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492335c1-4ee1-4a0b-b2a1-ba4a1f3265e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:15.689939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492335c1-4ee1-4a0b-b2a1-ba4a1f3265e7 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:15.690561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492335c1-4ee1-4a0b-b2a1-ba4a1f3265e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:15.690858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492335c1-4ee1-4a0b-b2a1-ba4a1f3265e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:15.692305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492335c1-4ee1-4a0b-b2a1-ba4a1f3265e7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:15.701773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 509/1014] 10.222.0.55 () {56 vars in 1122 bytes} [Fri Sep 2 09:14:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:15.702821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70772af8-bbdc-4656-9e6e-786e8ada0aa4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:15.803642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70772af8-bbdc-4656-9e6e-786e8ada0aa4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:15.843610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc4370-a3d9-4c1a-b90e-0cd9e7e429c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:15.844251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc4370-a3d9-4c1a-b90e-0cd9e7e429c5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:15.844527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc4370-a3d9-4c1a-b90e-0cd9e7e429c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:15.844794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc4370-a3d9-4c1a-b90e-0cd9e7e429c5 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:15.845414 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc4370-a3d9-4c1a-b90e-0cd9e7e429c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:15.845711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc4370-a3d9-4c1a-b90e-0cd9e7e429c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:15.847074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc4370-a3d9-4c1a-b90e-0cd9e7e429c5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:15.852514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 506/1015] 10.222.0.55 () {56 vars in 1122 bytes} [Fri Sep 2 09:14:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:15.858858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492335c1-4ee1-4a0b-b2a1-ba4a1f3265e7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:15.919219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:15.961031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492335c1-4ee1-4a0b-b2a1-ba4a1f3265e7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:15.996507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f25a0-9bc6-4d4a-8e07-f14bb838e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:15.997118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f25a0-9bc6-4d4a-8e07-f14bb838e8e8 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:15.997393 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f25a0-9bc6-4d4a-8e07-f14bb838e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:15.997664 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f25a0-9bc6-4d4a-8e07-f14bb838e8e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:15.998327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f25a0-9bc6-4d4a-8e07-f14bb838e8e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:15.999704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f25a0-9bc6-4d4a-8e07-f14bb838e8e8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:16.079934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 510/1016] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:14:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:14:16.271221 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc382d0-5018-4b5e-85de-9591c0e0b810 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:16.271724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc382d0-5018-4b5e-85de-9591c0e0b810 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:16.271724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc382d0-5018-4b5e-85de-9591c0e0b810 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:16.273184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 507/1017] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:16.278098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865433ec-cc91-4b6e-b1a0-a42853f87a34 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:16.278387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865433ec-cc91-4b6e-b1a0-a42853f87a34 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:16.278658 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865433ec-cc91-4b6e-b1a0-a42853f87a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:16.297091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-865433ec-cc91-4b6e-b1a0-a42853f87a34 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:16.298270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-865433ec-cc91-4b6e-b1a0-a42853f87a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:16.370049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 511/1018] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:16.636656 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc382d0-5018-4b5e-85de-9591c0e0b810 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:16.693620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:16.739425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc382d0-5018-4b5e-85de-9591c0e0b810 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:16.774733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e17106-ce54-4f84-9606-0c4cb0710352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:16.775358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e17106-ce54-4f84-9606-0c4cb0710352 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:16.775651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e17106-ce54-4f84-9606-0c4cb0710352 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:16.776008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e17106-ce54-4f84-9606-0c4cb0710352 None admin] PATH_INFO: `/v3/services/image` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:16.776495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e17106-ce54-4f84-9606-0c4cb0710352 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:16.777854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e17106-ce54-4f84-9606-0c4cb0710352 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b7e17106-ce54-4f84-9606-0c4cb0710352 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:16.786894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:16.787938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 09:14:16.788804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:16.792209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 508/1019] 10.222.0.55 () {56 vars in 1105 bytes} [Fri Sep 2 09:14:16 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:16.793883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865433ec-cc91-4b6e-b1a0-a42853f87a34 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:16.844559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:16.897750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865433ec-cc91-4b6e-b1a0-a42853f87a34 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:16.933572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbde5d-af10-40d3-85d9-e81cae0f2c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:16.934346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbde5d-af10-40d3-85d9-e81cae0f2c18 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:16.934722 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbde5d-af10-40d3-85d9-e81cae0f2c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:16.935092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbde5d-af10-40d3-85d9-e81cae0f2c18 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:16.936459 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbde5d-af10-40d3-85d9-e81cae0f2c18 None admin] RBAC: Adding query filter params (name=image) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:16.936863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbde5d-af10-40d3-85d9-e81cae0f2c18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:16.938321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbde5d-af10-40d3-85d9-e81cae0f2c18 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:16.948121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 512/1020] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:16.949281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e17106-ce54-4f84-9606-0c4cb0710352 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:16.983972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e3bc-b980-435c-8872-6a2dd3ccccbd None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:16.984256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e3bc-b980-435c-8872-6a2dd3ccccbd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:16.984531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e3bc-b980-435c-8872-6a2dd3ccccbd None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:16.986007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 513/1021] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:16.990588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d6a64-faca-41ce-a730-7b50a0d06aa7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:16.990867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d6a64-faca-41ce-a730-7b50a0d06aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:16.991139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d6a64-faca-41ce-a730-7b50a0d06aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:17.010050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-234d6a64-faca-41ce-a730-7b50a0d06aa7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:17.011246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-234d6a64-faca-41ce-a730-7b50a0d06aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:17.057969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e17106-ce54-4f84-9606-0c4cb0710352 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:17.077985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:17.091919 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 514/1022] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:17.098104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31dc9-e225-413e-b077-fa52b50875b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:17.098926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31dc9-e225-413e-b077-fa52b50875b5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:17.099206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31dc9-e225-413e-b077-fa52b50875b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:17.099480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31dc9-e225-413e-b077-fa52b50875b5 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:17.100143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa31dc9-e225-413e-b077-fa52b50875b5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:17.100447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa31dc9-e225-413e-b077-fa52b50875b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:17.101855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa31dc9-e225-413e-b077-fa52b50875b5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:17.107033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 509/1023] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:17.113600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d6a64-faca-41ce-a730-7b50a0d06aa7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:17.156153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:17.215779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d6a64-faca-41ce-a730-7b50a0d06aa7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:17.250102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ecca1-8e8d-45e2-9fb2-94aef7506c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:17.250705 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ecca1-8e8d-45e2-9fb2-94aef7506c11 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:17.250988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ecca1-8e8d-45e2-9fb2-94aef7506c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:17.251259 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ecca1-8e8d-45e2-9fb2-94aef7506c11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:17.251969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ecca1-8e8d-45e2-9fb2-94aef7506c11 None admin] RBAC: Adding query filter params (interface=public, service_id=51972190abd647d79d00fb2228e9f858, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:17.252276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ecca1-8e8d-45e2-9fb2-94aef7506c11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:17.253634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ecca1-8e8d-45e2-9fb2-94aef7506c11 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:17.258741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 515/1024] 10.222.0.55 () {56 vars in 1251 bytes} [Fri Sep 2 09:14:17 2022] GET /identity/v3/endpoints?service_id=51972190abd647d79d00fb2228e9f858&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:17.264312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31dc9-e225-413e-b077-fa52b50875b5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:17.362474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31dc9-e225-413e-b077-fa52b50875b5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:17.367660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ecca1-8e8d-45e2-9fb2-94aef7506c11 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:17.397669 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13866299-84b1-42b8-86db-e5c3ea728880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:17.398298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13866299-84b1-42b8-86db-e5c3ea728880 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:17.398588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13866299-84b1-42b8-86db-e5c3ea728880 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:17.398853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13866299-84b1-42b8-86db-e5c3ea728880 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:17.399456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13866299-84b1-42b8-86db-e5c3ea728880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:17.400858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13866299-84b1-42b8-86db-e5c3ea728880 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:17.408497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 510/1025] 10.222.0.55 () {56 vars in 1087 bytes} [Fri Sep 2 09:14:17 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:14:17.484581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ecca1-8e8d-45e2-9fb2-94aef7506c11 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:17.486346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:17.521895 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf3395-7ac6-49ac-8088-69c9a8ab70be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:17.522540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf3395-7ac6-49ac-8088-69c9a8ab70be None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:17.522816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf3395-7ac6-49ac-8088-69c9a8ab70be None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:17.523084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf3395-7ac6-49ac-8088-69c9a8ab70be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:17.534898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf3395-7ac6-49ac-8088-69c9a8ab70be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-13bf3395-7ac6-49ac-8088-69c9a8ab70be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:17.539903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:17.540898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:17.545427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 516/1026] 10.222.0.55 () {56 vars in 1120 bytes} [Fri Sep 2 09:14:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:17.547799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13866299-84b1-42b8-86db-e5c3ea728880 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:17.598498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:17.652125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13866299-84b1-42b8-86db-e5c3ea728880 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:17.685935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31079c73-44ad-45fa-bf79-a2239b340a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:17.686462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31079c73-44ad-45fa-bf79-a2239b340a5f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:17.686737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31079c73-44ad-45fa-bf79-a2239b340a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:17.687008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31079c73-44ad-45fa-bf79-a2239b340a5f None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:17.687660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31079c73-44ad-45fa-bf79-a2239b340a5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:17.687987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31079c73-44ad-45fa-bf79-a2239b340a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:17.689361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31079c73-44ad-45fa-bf79-a2239b340a5f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:17.697646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 511/1027] 10.222.0.55 () {56 vars in 1115 bytes} [Fri Sep 2 09:14:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:17.703585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf3395-7ac6-49ac-8088-69c9a8ab70be None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:17.807209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf3395-7ac6-49ac-8088-69c9a8ab70be None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:17.850400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ad7d-7daa-4c77-bb70-ae1f55d32006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:17.851036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ad7d-7daa-4c77-bb70-ae1f55d32006 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:17.851310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ad7d-7daa-4c77-bb70-ae1f55d32006 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:17.851581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ad7d-7daa-4c77-bb70-ae1f55d32006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:17.862091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ad7d-7daa-4c77-bb70-ae1f55d32006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:17.863529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ad7d-7daa-4c77-bb70-ae1f55d32006 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-bdd5ad7d-7daa-4c77-bb70-ae1f55d32006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:17.878785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:17.879768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:17.881013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:17.881013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:17.881013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:17.883952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 517/1028] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:17.885862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31079c73-44ad-45fa-bf79-a2239b340a5f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:17.990584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31079c73-44ad-45fa-bf79-a2239b340a5f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:17.992704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc752463-f486-4552-aabb-c341e92b0308 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:17.993170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc752463-f486-4552-aabb-c341e92b0308 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:17.993266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc752463-f486-4552-aabb-c341e92b0308 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:17.994706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 518/1029] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:14:18.000276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728414-ba4f-4f81-b226-f3c3a0c3c1bc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:18.000555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728414-ba4f-4f81-b226-f3c3a0c3c1bc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:18.000827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728414-ba4f-4f81-b226-f3c3a0c3c1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:18.001546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:18.019599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-27728414-ba4f-4f81-b226-f3c3a0c3c1bc None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:18.021302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-27728414-ba4f-4f81-b226-f3c3a0c3c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:18.028955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c338db-e0be-4804-bcd3-21c0781ddb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:18.028955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c338db-e0be-4804-bcd3-21c0781ddb1f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:18.028955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c338db-e0be-4804-bcd3-21c0781ddb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:18.029269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c338db-e0be-4804-bcd3-21c0781ddb1f None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:18.029798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c338db-e0be-4804-bcd3-21c0781ddb1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:18.029992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c338db-e0be-4804-bcd3-21c0781ddb1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:18.031305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c338db-e0be-4804-bcd3-21c0781ddb1f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:18.032176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:18.045067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 512/1030] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:18.050377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c338db-e0be-4804-bcd3-21c0781ddb1f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:18.098539 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 519/1031] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:18.154563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c338db-e0be-4804-bcd3-21c0781ddb1f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:18.188489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21dce7-0a26-4d13-ad0a-8997f5c49b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:18.189107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21dce7-0a26-4d13-ad0a-8997f5c49b22 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:18.189383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21dce7-0a26-4d13-ad0a-8997f5c49b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:18.189653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21dce7-0a26-4d13-ad0a-8997f5c49b22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:18.196402 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21dce7-0a26-4d13-ad0a-8997f5c49b22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:18.197832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21dce7-0a26-4d13-ad0a-8997f5c49b22 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-4c21dce7-0a26-4d13-ad0a-8997f5c49b22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:14:18.209740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:18.210682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:18.211657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:18.211657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:18.211657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:14:18.211657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:14:18.211657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:14:18.211657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:14:18.211657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:14:18.211657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:14:18.211657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:14:18.211657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:18.215587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 513/1032] 10.222.0.55 () {56 vars in 1093 bytes} [Fri Sep 2 09:14:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:18.216880 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728414-ba4f-4f81-b226-f3c3a0c3c1bc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:18.316829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728414-ba4f-4f81-b226-f3c3a0c3c1bc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:18.350232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6bb4d-a462-4f9d-bdde-d28eb23e38be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:18.351208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6bb4d-a462-4f9d-bdde-d28eb23e38be None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:18.351208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6bb4d-a462-4f9d-bdde-d28eb23e38be None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:18.351378 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6bb4d-a462-4f9d-bdde-d28eb23e38be None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:18.352058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6bb4d-a462-4f9d-bdde-d28eb23e38be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:18.352355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6bb4d-a462-4f9d-bdde-d28eb23e38be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:18.353765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6bb4d-a462-4f9d-bdde-d28eb23e38be None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:18.367687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21dce7-0a26-4d13-ad0a-8997f5c49b22 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:18.378355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 520/1033] 10.222.0.55 () {56 vars in 1133 bytes} [Fri Sep 2 09:14:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:18.380117 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6bb4d-a462-4f9d-bdde-d28eb23e38be None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:18.383700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:18.399595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:18.482490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21dce7-0a26-4d13-ad0a-8997f5c49b22 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:18.485779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6bb4d-a462-4f9d-bdde-d28eb23e38be None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:18.522097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab880a01-0f66-48ae-b748-65598d270323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:18.522716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab880a01-0f66-48ae-b748-65598d270323 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:18.522977 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab880a01-0f66-48ae-b748-65598d270323 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:18.523244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab880a01-0f66-48ae-b748-65598d270323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:18.524760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12767-3ac0-4be7-8aea-5f50c5702fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:18.525783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12767-3ac0-4be7-8aea-5f50c5702fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:18.526220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12767-3ac0-4be7-8aea-5f50c5702fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:18.527527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12767-3ac0-4be7-8aea-5f50c5702fd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:18.528832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12767-3ac0-4be7-8aea-5f50c5702fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:18.530977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12767-3ac0-4be7-8aea-5f50c5702fd9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:18.533547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 514/1034] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:18.539047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12767-3ac0-4be7-8aea-5f50c5702fd9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:18.593852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab880a01-0f66-48ae-b748-65598d270323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:18.595217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab880a01-0f66-48ae-b748-65598d270323 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:18.597148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:18.641771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:18.648553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12767-3ac0-4be7-8aea-5f50c5702fd9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:18.685113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13887b5b-caae-4878-930e-1e34015d8b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:18.685736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13887b5b-caae-4878-930e-1e34015d8b6d None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:18.686009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13887b5b-caae-4878-930e-1e34015d8b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:18.686275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13887b5b-caae-4878-930e-1e34015d8b6d None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:18.686909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13887b5b-caae-4878-930e-1e34015d8b6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:18.688368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13887b5b-caae-4878-930e-1e34015d8b6d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:18.709548 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 521/1035] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:18 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:14:18.715210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab880a01-0f66-48ae-b748-65598d270323 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:18.783915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 515/1036] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:14:18 2022] POST /identity/v3/projects => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:18.818522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab880a01-0f66-48ae-b748-65598d270323 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:18.820721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:18.859322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eccbb1-209a-4efd-b7af-cfc7d750bc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:18.859978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eccbb1-209a-4efd-b7af-cfc7d750bc02 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:18.860189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eccbb1-209a-4efd-b7af-cfc7d750bc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:18.860458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eccbb1-209a-4efd-b7af-cfc7d750bc02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:18.872362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eccbb1-209a-4efd-b7af-cfc7d750bc02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:18.874414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eccbb1-209a-4efd-b7af-cfc7d750bc02 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-80eccbb1-209a-4efd-b7af-cfc7d750bc02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:18.891327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:18.892384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:18.898054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:18.898054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:18.898054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:18.898054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 522/1037] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:18.898773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13887b5b-caae-4878-930e-1e34015d8b6d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:19.006792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13887b5b-caae-4878-930e-1e34015d8b6d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:19.041915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b267483-2781-4c1d-88e6-90a9379a0acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:19.042524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267483-2781-4c1d-88e6-90a9379a0acf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:19.042798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267483-2781-4c1d-88e6-90a9379a0acf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:19.043070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267483-2781-4c1d-88e6-90a9379a0acf None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:19.043712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b267483-2781-4c1d-88e6-90a9379a0acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:19.044046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b267483-2781-4c1d-88e6-90a9379a0acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:19.045450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b267483-2781-4c1d-88e6-90a9379a0acf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:19.056910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 516/1038] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:19.063246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eccbb1-209a-4efd-b7af-cfc7d750bc02 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:19.165414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eccbb1-209a-4efd-b7af-cfc7d750bc02 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:19.200014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aac85-5011-46cb-be9a-a2bc1c8c0cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:19.200647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aac85-5011-46cb-be9a-a2bc1c8c0cba None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:19.200923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aac85-5011-46cb-be9a-a2bc1c8c0cba None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:19.201234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aac85-5011-46cb-be9a-a2bc1c8c0cba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:19.208091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aac85-5011-46cb-be9a-a2bc1c8c0cba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:19.209531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aac85-5011-46cb-be9a-a2bc1c8c0cba None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-212aac85-5011-46cb-be9a-a2bc1c8c0cba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:14:19.220928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:19.221821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:19.222727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:14:19.222727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:14:19.222727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:14:19.222727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:14:19.222727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:14:19.222727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:14:19.222727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:19.222727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:19.222727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 523/1039] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:14:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:19.229062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b267483-2781-4c1d-88e6-90a9379a0acf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:19.241376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:19.333664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b267483-2781-4c1d-88e6-90a9379a0acf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:19.346633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb7b19-1690-4340-b53e-af73ce887bc6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:19.346986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb7b19-1690-4340-b53e-af73ce887bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:19.347314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb7b19-1690-4340-b53e-af73ce887bc6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:19.351907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 524/1040] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:14:19.354007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f15862-1ae6-4dd7-92ee-97646507f47d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:19.354461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f15862-1ae6-4dd7-92ee-97646507f47d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:19.354878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f15862-1ae6-4dd7-92ee-97646507f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:19.373711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907d009-0d45-4440-85ae-7f0a8b323bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:19.374324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907d009-0d45-4440-85ae-7f0a8b323bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:19.374658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907d009-0d45-4440-85ae-7f0a8b323bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:19.374940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907d009-0d45-4440-85ae-7f0a8b323bf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:19.375322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-73f15862-1ae6-4dd7-92ee-97646507f47d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:19.375658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907d009-0d45-4440-85ae-7f0a8b323bf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:19.375992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907d009-0d45-4440-85ae-7f0a8b323bf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:19.377026 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-73f15862-1ae6-4dd7-92ee-97646507f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:19.377431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907d009-0d45-4440-85ae-7f0a8b323bf2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:19.390012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 517/1041] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:19.391796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:19.395944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907d009-0d45-4440-85ae-7f0a8b323bf2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:19.459978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 525/1042] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:19.468079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:19.502579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907d009-0d45-4440-85ae-7f0a8b323bf2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:19.536431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbebfd-c53d-4e1a-8ed2-6dda93e176db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:19.537034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbebfd-c53d-4e1a-8ed2-6dda93e176db None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:19.537311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbebfd-c53d-4e1a-8ed2-6dda93e176db None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:19.537584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbebfd-c53d-4e1a-8ed2-6dda93e176db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:19.538323 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbebfd-c53d-4e1a-8ed2-6dda93e176db None admin] RBAC: Adding query filter params (role.id=ae7422720c0043d0b7f44c53804eac0c, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=5d74d78932554527a8bcb5880b2b9c96) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:19.538629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbebfd-c53d-4e1a-8ed2-6dda93e176db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:19.540083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbebfd-c53d-4e1a-8ed2-6dda93e176db None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:19.546123 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 518/1043] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:14:19 2022] GET /identity/v3/role_assignments?user.id=5d74d78932554527a8bcb5880b2b9c96&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=ae7422720c0043d0b7f44c53804eac0c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:19.725345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f15862-1ae6-4dd7-92ee-97646507f47d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:19.836173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f15862-1ae6-4dd7-92ee-97646507f47d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:19.874200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba68d-b816-4d78-921c-15d6bddcaa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:19.874824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba68d-b816-4d78-921c-15d6bddcaa25 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:19.875155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba68d-b816-4d78-921c-15d6bddcaa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:19.875428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba68d-b816-4d78-921c-15d6bddcaa25 None admin] PATH_INFO: `/v3/services/image` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:19.876025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ba68d-b816-4d78-921c-15d6bddcaa25 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:19.877376 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ba68d-b816-4d78-921c-15d6bddcaa25 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-fb8ba68d-b816-4d78-921c-15d6bddcaa25 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:19.886121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:19.887087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 09:14:19.888060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:19.892035 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 526/1044] 10.222.0.55 () {56 vars in 1105 bytes} [Fri Sep 2 09:14:19 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:19.893792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbebfd-c53d-4e1a-8ed2-6dda93e176db None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:19.999624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbebfd-c53d-4e1a-8ed2-6dda93e176db None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:20.028616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:20.034522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344107d8-0da4-4b35-9dce-5c202b4b0de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:20.035120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344107d8-0da4-4b35-9dce-5c202b4b0de7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:20.035390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344107d8-0da4-4b35-9dce-5c202b4b0de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:20.035655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344107d8-0da4-4b35-9dce-5c202b4b0de7 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:20.036306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344107d8-0da4-4b35-9dce-5c202b4b0de7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:20.036598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344107d8-0da4-4b35-9dce-5c202b4b0de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:20.048831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344107d8-0da4-4b35-9dce-5c202b4b0de7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:20.048831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 519/1045] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:20.049033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba68d-b816-4d78-921c-15d6bddcaa25 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:20.060636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:20.152975 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba68d-b816-4d78-921c-15d6bddcaa25 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:20.187534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07417bf9-2859-4c08-890e-13ecc647cdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:20.188165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07417bf9-2859-4c08-890e-13ecc647cdc1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:20.188442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07417bf9-2859-4c08-890e-13ecc647cdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:20.188711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07417bf9-2859-4c08-890e-13ecc647cdc1 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:20.189326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07417bf9-2859-4c08-890e-13ecc647cdc1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:20.189620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07417bf9-2859-4c08-890e-13ecc647cdc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:20.190974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07417bf9-2859-4c08-890e-13ecc647cdc1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:20.200319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 527/1046] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:20.202143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344107d8-0da4-4b35-9dce-5c202b4b0de7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:20.302661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344107d8-0da4-4b35-9dce-5c202b4b0de7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:20.336618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb2293-e1f3-4753-928d-887ba6dded35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:20.337217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2293-e1f3-4753-928d-887ba6dded35 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:20.337493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2293-e1f3-4753-928d-887ba6dded35 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:20.337761 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2293-e1f3-4753-928d-887ba6dded35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:20.338427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb2293-e1f3-4753-928d-887ba6dded35 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:20.339787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb2293-e1f3-4753-928d-887ba6dded35 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:20.434962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 520/1047] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:14:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:20.750156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce54a4c-808c-41bf-bb5f-e1cbbea36af4 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:20.750467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce54a4c-808c-41bf-bb5f-e1cbbea36af4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:20.750654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce54a4c-808c-41bf-bb5f-e1cbbea36af4 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:20.751985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 528/1048] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:20.757264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dc3d6-3a1e-4b67-82c6-322578d60e18 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:20.757558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dc3d6-3a1e-4b67-82c6-322578d60e18 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:20.757839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dc3d6-3a1e-4b67-82c6-322578d60e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:20.776726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5a4dc3d6-3a1e-4b67-82c6-322578d60e18 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:20.777903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5a4dc3d6-3a1e-4b67-82c6-322578d60e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:20.829011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:20.858295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 521/1049] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:21.121637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce54a4c-808c-41bf-bb5f-e1cbbea36af4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:21.194000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:21.225158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce54a4c-808c-41bf-bb5f-e1cbbea36af4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:21.258820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca380c-5883-471b-81a4-bcef414e4a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:21.259433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca380c-5883-471b-81a4-bcef414e4a04 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:21.259703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca380c-5883-471b-81a4-bcef414e4a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:21.260061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca380c-5883-471b-81a4-bcef414e4a04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:21.261149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca380c-5883-471b-81a4-bcef414e4a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:21.262555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca380c-5883-471b-81a4-bcef414e4a04 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:21.264843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 529/1050] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:21.270295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dc3d6-3a1e-4b67-82c6-322578d60e18 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:21.368293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dc3d6-3a1e-4b67-82c6-322578d60e18 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:21.402449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73198dce-0115-463c-91c6-17c3e8b92816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:21.402970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73198dce-0115-463c-91c6-17c3e8b92816 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:21.403242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73198dce-0115-463c-91c6-17c3e8b92816 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:21.403509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73198dce-0115-463c-91c6-17c3e8b92816 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:21.404186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73198dce-0115-463c-91c6-17c3e8b92816 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:21.405648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73198dce-0115-463c-91c6-17c3e8b92816 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:21.431750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc25a8-3cc4-442d-97f9-81b5c4c62de7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:21.432188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc25a8-3cc4-442d-97f9-81b5c4c62de7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:21.432546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc25a8-3cc4-442d-97f9-81b5c4c62de7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:21.433987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 530/1051] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:14:21.439325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7e6c-f0ad-445a-9219-d1b585657ee7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:21.439607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7e6c-f0ad-445a-9219-d1b585657ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:21.439902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7e6c-f0ad-445a-9219-d1b585657ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:21.458054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-15cc7e6c-f0ad-445a-9219-d1b585657ee7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:21.459250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-15cc7e6c-f0ad-445a-9219-d1b585657ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:21.492213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 522/1052] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:14:21 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:21.539224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 531/1053] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:21.805660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73198dce-0115-463c-91c6-17c3e8b92816 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:21.849362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:21.916011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73198dce-0115-463c-91c6-17c3e8b92816 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:21.949373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe36d0-f9b5-4f58-837a-ed969ecaf401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:21.950004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe36d0-f9b5-4f58-837a-ed969ecaf401 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:21.950276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe36d0-f9b5-4f58-837a-ed969ecaf401 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:21.950546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe36d0-f9b5-4f58-837a-ed969ecaf401 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:21.961155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe36d0-f9b5-4f58-837a-ed969ecaf401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-53fe36d0-f9b5-4f58-837a-ed969ecaf401 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:21.966407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:21.967298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:21.968201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 523/1054] 10.222.0.55 () {56 vars in 1120 bytes} [Fri Sep 2 09:14:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:21.973784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7e6c-f0ad-445a-9219-d1b585657ee7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:22.042537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:22.073273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7e6c-f0ad-445a-9219-d1b585657ee7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:22.106930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ce3b9-f969-486e-971b-440a3e43fa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:22.108060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ce3b9-f969-486e-971b-440a3e43fa0f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:22.108345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ce3b9-f969-486e-971b-440a3e43fa0f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:22.108612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ce3b9-f969-486e-971b-440a3e43fa0f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:22.109257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ce3b9-f969-486e-971b-440a3e43fa0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:22.109552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ce3b9-f969-486e-971b-440a3e43fa0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:22.110900 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ce3b9-f969-486e-971b-440a3e43fa0f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:22.123903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 532/1055] 10.222.0.55 () {56 vars in 1115 bytes} [Fri Sep 2 09:14:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:22.125689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe36d0-f9b5-4f58-837a-ed969ecaf401 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:22.218328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:22.225477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe36d0-f9b5-4f58-837a-ed969ecaf401 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:22.259365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453eda40-dc22-4c0d-9962-1cc5466caa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:22.260013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eda40-dc22-4c0d-9962-1cc5466caa85 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:22.260289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eda40-dc22-4c0d-9962-1cc5466caa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:22.260557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eda40-dc22-4c0d-9962-1cc5466caa85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:22.270920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453eda40-dc22-4c0d-9962-1cc5466caa85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:22.272401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453eda40-dc22-4c0d-9962-1cc5466caa85 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-453eda40-dc22-4c0d-9962-1cc5466caa85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:22.286150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:22.287075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:22.288027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:22.288027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:22.288027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:22.288027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 524/1056] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:22.294004 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ce3b9-f969-486e-971b-440a3e43fa0f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:22.371462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15134-8cd2-4b77-9434-3e7404977683 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:22.371759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15134-8cd2-4b77-9434-3e7404977683 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:22.372222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15134-8cd2-4b77-9434-3e7404977683 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:22.374510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 525/1057] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:14:22.379091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e29188-84dd-4470-9c08-0e5dbce8a17d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:22.386655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e29188-84dd-4470-9c08-0e5dbce8a17d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:22.386655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e29188-84dd-4470-9c08-0e5dbce8a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:22.398299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d7e29188-84dd-4470-9c08-0e5dbce8a17d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:22.399550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d7e29188-84dd-4470-9c08-0e5dbce8a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:22.401679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ce3b9-f969-486e-971b-440a3e43fa0f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:22.433125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:22.439198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f75e9-e456-4da7-9e42-0b889089867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:22.439806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f75e9-e456-4da7-9e42-0b889089867e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:22.440113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f75e9-e456-4da7-9e42-0b889089867e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:22.440385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f75e9-e456-4da7-9e42-0b889089867e None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:22.441016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f75e9-e456-4da7-9e42-0b889089867e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:22.441632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f75e9-e456-4da7-9e42-0b889089867e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:22.442730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f75e9-e456-4da7-9e42-0b889089867e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:22.459523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 533/1058] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:22.460655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f75e9-e456-4da7-9e42-0b889089867e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:22.470718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 526/1059] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:22.562492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f75e9-e456-4da7-9e42-0b889089867e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:22.596070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ea1e-3cbd-4784-ba6c-d43a27c8bdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:22.596687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ea1e-3cbd-4784-ba6c-d43a27c8bdb9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:22.596965 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ea1e-3cbd-4784-ba6c-d43a27c8bdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:22.597237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ea1e-3cbd-4784-ba6c-d43a27c8bdb9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:22.604105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1ea1e-3cbd-4784-ba6c-d43a27c8bdb9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:22.605542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1ea1e-3cbd-4784-ba6c-d43a27c8bdb9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f0a1ea1e-3cbd-4784-ba6c-d43a27c8bdb9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:14:22.618504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:22.619503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:22.625129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 534/1060] 10.222.0.55 () {56 vars in 1093 bytes} [Fri Sep 2 09:14:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:22.628157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e29188-84dd-4470-9c08-0e5dbce8a17d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:22.704664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:22.727262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e29188-84dd-4470-9c08-0e5dbce8a17d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:22.740481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ea1e-3cbd-4784-ba6c-d43a27c8bdb9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:22.763022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cd7ab-a8ff-4f31-bdea-4a97ee0007a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:22.763624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cd7ab-a8ff-4f31-bdea-4a97ee0007a4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:22.763947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cd7ab-a8ff-4f31-bdea-4a97ee0007a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:22.764221 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cd7ab-a8ff-4f31-bdea-4a97ee0007a4 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:22.764929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cd7ab-a8ff-4f31-bdea-4a97ee0007a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:22.765223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cd7ab-a8ff-4f31-bdea-4a97ee0007a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:22.766865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cd7ab-a8ff-4f31-bdea-4a97ee0007a4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:22.787839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 527/1061] 10.222.0.55 () {56 vars in 1133 bytes} [Fri Sep 2 09:14:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:22.790085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cd7ab-a8ff-4f31-bdea-4a97ee0007a4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:22.797730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:22.851931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ea1e-3cbd-4784-ba6c-d43a27c8bdb9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:22.892520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba1c13-9dcb-4e65-8ed6-444a2a46a37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:22.893290 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba1c13-9dcb-4e65-8ed6-444a2a46a37a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:22.893568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba1c13-9dcb-4e65-8ed6-444a2a46a37a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:22.894234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba1c13-9dcb-4e65-8ed6-444a2a46a37a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:22.899672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cd7ab-a8ff-4f31-bdea-4a97ee0007a4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:22.935647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47da9e-d986-4e56-9443-8642dd778979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:22.936352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47da9e-d986-4e56-9443-8642dd778979 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:22.936629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47da9e-d986-4e56-9443-8642dd778979 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:22.936901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47da9e-d986-4e56-9443-8642dd778979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:22.938913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:22.947466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47da9e-d986-4e56-9443-8642dd778979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:22.948943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47da9e-d986-4e56-9443-8642dd778979 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3f47da9e-d986-4e56-9443-8642dd778979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:22.964581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:22.965583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:22.971963 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:22.971963 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:22.971963 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:22.971963 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 528/1062] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:22.971963 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47da9e-d986-4e56-9443-8642dd778979 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:22.975950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba1c13-9dcb-4e65-8ed6-444a2a46a37a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:22.977489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba1c13-9dcb-4e65-8ed6-444a2a46a37a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:23.033517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:23.073321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47da9e-d986-4e56-9443-8642dd778979 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:23.083493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 535/1063] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 09:14:23.088801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba1c13-9dcb-4e65-8ed6-444a2a46a37a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:23.114248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860be4-4b6e-4dd2-bb8e-0c95c5e43f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:23.114854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860be4-4b6e-4dd2-bb8e-0c95c5e43f42 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:23.115127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860be4-4b6e-4dd2-bb8e-0c95c5e43f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:23.115395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860be4-4b6e-4dd2-bb8e-0c95c5e43f42 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:23.116060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860be4-4b6e-4dd2-bb8e-0c95c5e43f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:23.116363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860be4-4b6e-4dd2-bb8e-0c95c5e43f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:23.117722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860be4-4b6e-4dd2-bb8e-0c95c5e43f42 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:23.130342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 529/1064] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:23.135844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860be4-4b6e-4dd2-bb8e-0c95c5e43f42 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:23.183847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:23.193037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba1c13-9dcb-4e65-8ed6-444a2a46a37a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:23.228685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adec922-4d06-4f4c-8c8f-1b935db40554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:23.229306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec922-4d06-4f4c-8c8f-1b935db40554 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:23.229579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec922-4d06-4f4c-8c8f-1b935db40554 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:23.229844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec922-4d06-4f4c-8c8f-1b935db40554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:23.239757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adec922-4d06-4f4c-8c8f-1b935db40554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:23.241271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adec922-4d06-4f4c-8c8f-1b935db40554 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:23.243429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860be4-4b6e-4dd2-bb8e-0c95c5e43f42 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4adec922-4d06-4f4c-8c8f-1b935db40554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:23.258907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:23.259840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:23.260755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:23.260755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:23.260755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:23.262127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 536/1065] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:23.268497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adec922-4d06-4f4c-8c8f-1b935db40554 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:23.272420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:23.286417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbfac9-4f08-44f5-88bc-1217ebd5367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:23.287059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbfac9-4f08-44f5-88bc-1217ebd5367f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:23.287336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbfac9-4f08-44f5-88bc-1217ebd5367f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:23.287598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbfac9-4f08-44f5-88bc-1217ebd5367f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:23.295114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbfac9-4f08-44f5-88bc-1217ebd5367f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:23.296597 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbfac9-4f08-44f5-88bc-1217ebd5367f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1fdbfac9-4f08-44f5-88bc-1217ebd5367f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:14:23.308257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:23.309183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:23.310072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:14:23.310072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:14:23.310072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:14:23.310072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:14:23.310072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:14:23.310072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:14:23.310072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:23.310072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:23.310072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 530/1066] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:14:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:23.315530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbfac9-4f08-44f5-88bc-1217ebd5367f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:23.380367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adec922-4d06-4f4c-8c8f-1b935db40554 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:23.415159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f982d6-f1a2-4637-a412-e947703a4749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:23.415872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f982d6-f1a2-4637-a412-e947703a4749 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:23.416181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f982d6-f1a2-4637-a412-e947703a4749 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:23.416435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f982d6-f1a2-4637-a412-e947703a4749 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:23.417065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f982d6-f1a2-4637-a412-e947703a4749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:23.417361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f982d6-f1a2-4637-a412-e947703a4749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:23.418710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f982d6-f1a2-4637-a412-e947703a4749 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:23.421931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbfac9-4f08-44f5-88bc-1217ebd5367f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:23.430262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:23.430404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 537/1067] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:23.461865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2db9-7808-46b0-b140-f599cc430972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:23.462221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4219a1e-94c3-4089-9613-14a1d5922974 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:23.462422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2db9-7808-46b0-b140-f599cc430972 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:23.462559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4219a1e-94c3-4089-9613-14a1d5922974 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:23.462642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2db9-7808-46b0-b140-f599cc430972 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:23.462829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4219a1e-94c3-4089-9613-14a1d5922974 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:23.462929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2db9-7808-46b0-b140-f599cc430972 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:23.463829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2db9-7808-46b0-b140-f599cc430972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:23.464132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2db9-7808-46b0-b140-f599cc430972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:23.466064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2db9-7808-46b0-b140-f599cc430972 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:23.468564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 538/1068] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:14:23.469943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f18e5e-d37e-445d-bdad-f2ec8ecca183 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:23.470228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f18e5e-d37e-445d-bdad-f2ec8ecca183 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:23.470505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f18e5e-d37e-445d-bdad-f2ec8ecca183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:23.481557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 531/1069] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:14:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:23.487620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2db9-7808-46b0-b140-f599cc430972 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:23.491450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-65f18e5e-d37e-445d-bdad-f2ec8ecca183 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:23.492719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-65f18e5e-d37e-445d-bdad-f2ec8ecca183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:23.557159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:23.567071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 539/1070] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:23.602026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2db9-7808-46b0-b140-f599cc430972 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:23.638664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac729adb-a572-4346-b0a5-63a206a62020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:23.639413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac729adb-a572-4346-b0a5-63a206a62020 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:23.639595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac729adb-a572-4346-b0a5-63a206a62020 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:23.639868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac729adb-a572-4346-b0a5-63a206a62020 None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/5d74d78932554527a8bcb5880b2b9c96/roles/ae7422720c0043d0b7f44c53804eac0c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:23.642078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac729adb-a572-4346-b0a5-63a206a62020 None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=5d74d78932554527a8bcb5880b2b9c96, role_id=ae7422720c0043d0b7f44c53804eac0c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:23.643550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac729adb-a572-4346-b0a5-63a206a62020 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:23.708871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 532/1071] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:14:23 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/5d74d78932554527a8bcb5880b2b9c96/roles/ae7422720c0043d0b7f44c53804eac0c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:14:23.838150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f18e5e-d37e-445d-bdad-f2ec8ecca183 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:23.933797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f18e5e-d37e-445d-bdad-f2ec8ecca183 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:23.966807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fffdb-d850-4849-8b46-d2f20c20f9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:23.967976 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fffdb-d850-4849-8b46-d2f20c20f9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:23.968255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fffdb-d850-4849-8b46-d2f20c20f9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:23.968526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fffdb-d850-4849-8b46-d2f20c20f9c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:23.978311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fffdb-d850-4849-8b46-d2f20c20f9c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-527fffdb-d850-4849-8b46-d2f20c20f9c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:23.983791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:23.984868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:23.985702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 540/1072] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:23.990939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac729adb-a572-4346-b0a5-63a206a62020 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:24.018437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:24.092824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac729adb-a572-4346-b0a5-63a206a62020 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:24.126072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a310d-b4ab-4253-b609-7d0557d56878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:24.126671 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a310d-b4ab-4253-b609-7d0557d56878 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:24.126949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a310d-b4ab-4253-b609-7d0557d56878 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:24.127217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a310d-b4ab-4253-b609-7d0557d56878 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:24.127866 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a310d-b4ab-4253-b609-7d0557d56878 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:24.128195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a310d-b4ab-4253-b609-7d0557d56878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:24.129554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a310d-b4ab-4253-b609-7d0557d56878 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:24.137497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 533/1073] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:24.143166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fffdb-d850-4849-8b46-d2f20c20f9c6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:24.197355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:24.240884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fffdb-d850-4849-8b46-d2f20c20f9c6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:24.272860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47abb3-7499-45ee-bffd-4ba3eea2a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:24.273472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47abb3-7499-45ee-bffd-4ba3eea2a67e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:24.273744 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47abb3-7499-45ee-bffd-4ba3eea2a67e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:24.274013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47abb3-7499-45ee-bffd-4ba3eea2a67e None admin] PATH_INFO: `/v3/users/8637f245ba5546fa82868500e0fc361d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:24.286998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47abb3-7499-45ee-bffd-4ba3eea2a67e None admin] RBAC: Authorizing `identity:get_user(user_id=8637f245ba5546fa82868500e0fc361d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:24.288446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47abb3-7499-45ee-bffd-4ba3eea2a67e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:24.290200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 541/1074] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:24 2022] GET /identity/v3/users/8637f245ba5546fa82868500e0fc361d => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:24.296604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a310d-b4ab-4253-b609-7d0557d56878 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:24.384360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:24.396574 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a310d-b4ab-4253-b609-7d0557d56878 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:24.429712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5315ea0-5b84-4392-970f-9fdc258e6be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:24.430309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5315ea0-5b84-4392-970f-9fdc258e6be2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:24.430585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5315ea0-5b84-4392-970f-9fdc258e6be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:24.430857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5315ea0-5b84-4392-970f-9fdc258e6be2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:24.495474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5315ea0-5b84-4392-970f-9fdc258e6be2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:24.496962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5315ea0-5b84-4392-970f-9fdc258e6be2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:24.584029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:24.596933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 534/1075] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:14:24.602844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47abb3-7499-45ee-bffd-4ba3eea2a67e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:24.699916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47abb3-7499-45ee-bffd-4ba3eea2a67e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:24.713197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:24.733913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1984163-88ab-49df-93a5-6575d73bdd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:24.734540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1984163-88ab-49df-93a5-6575d73bdd45 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:24.734818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1984163-88ab-49df-93a5-6575d73bdd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:24.735092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1984163-88ab-49df-93a5-6575d73bdd45 None admin] PATH_INFO: `/v3/projects/dafc00dce87c4d06b60fdc84020f11ef` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:24.736504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1984163-88ab-49df-93a5-6575d73bdd45 None admin] RBAC: Authorizing `identity:get_project(project_id=dafc00dce87c4d06b60fdc84020f11ef)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:24.738474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1984163-88ab-49df-93a5-6575d73bdd45 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:24.740157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 542/1076] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:14:24 2022] GET /identity/v3/projects/dafc00dce87c4d06b60fdc84020f11ef => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:24.746200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5315ea0-5b84-4392-970f-9fdc258e6be2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:24.849707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5315ea0-5b84-4392-970f-9fdc258e6be2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:24.883000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f62e-8ae0-4abb-a16b-0bfb8743f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:24.883595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f62e-8ae0-4abb-a16b-0bfb8743f90c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:24.883869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f62e-8ae0-4abb-a16b-0bfb8743f90c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:24.884163 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f62e-8ae0-4abb-a16b-0bfb8743f90c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:24.884873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533f62e-8ae0-4abb-a16b-0bfb8743f90c None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=dafc00dce87c4d06b60fdc84020f11ef, user.id=8637f245ba5546fa82868500e0fc361d) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:24.885176 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533f62e-8ae0-4abb-a16b-0bfb8743f90c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:24.886589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533f62e-8ae0-4abb-a16b-0bfb8743f90c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:24.892460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 535/1077] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:14:24 2022] GET /identity/v3/role_assignments?user.id=8637f245ba5546fa82868500e0fc361d&scope.project.id=dafc00dce87c4d06b60fdc84020f11ef&role.id=04d1bc62091440e189989e4b973a6627 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:25.589529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0cf13-57e9-4567-94d6-e83d0abd0d7c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:25.589844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0cf13-57e9-4567-94d6-e83d0abd0d7c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:25.590119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0cf13-57e9-4567-94d6-e83d0abd0d7c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:25.591465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 543/1078] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:14:25.597205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947df7a-d833-447d-a0fb-80bdc94898c1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:25.597553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947df7a-d833-447d-a0fb-80bdc94898c1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:25.597890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947df7a-d833-447d-a0fb-80bdc94898c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:25.616150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b947df7a-d833-447d-a0fb-80bdc94898c1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:25.617313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b947df7a-d833-447d-a0fb-80bdc94898c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:25.661435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:25.680592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 536/1079] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:25.947728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0cf13-57e9-4567-94d6-e83d0abd0d7c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:26.045769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0cf13-57e9-4567-94d6-e83d0abd0d7c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:26.078387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5b746-ba06-4dd0-9c78-2471fe477119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:26.079009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5b746-ba06-4dd0-9c78-2471fe477119 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:26.079286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5b746-ba06-4dd0-9c78-2471fe477119 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:26.079554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5b746-ba06-4dd0-9c78-2471fe477119 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:26.089339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5b746-ba06-4dd0-9c78-2471fe477119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3eb5b746-ba06-4dd0-9c78-2471fe477119 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:26.094156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:26.095043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:26.095926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 544/1080] 10.222.0.55 () {56 vars in 1120 bytes} [Fri Sep 2 09:14:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:26.101319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947df7a-d833-447d-a0fb-80bdc94898c1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:26.198687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947df7a-d833-447d-a0fb-80bdc94898c1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:26.231760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d4e1-f8ca-4425-8c89-e9079cd002c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:26.232391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d4e1-f8ca-4425-8c89-e9079cd002c9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:26.232668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d4e1-f8ca-4425-8c89-e9079cd002c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:26.233614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d4e1-f8ca-4425-8c89-e9079cd002c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:26.234268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301d4e1-f8ca-4425-8c89-e9079cd002c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:26.234570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301d4e1-f8ca-4425-8c89-e9079cd002c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:26.235955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301d4e1-f8ca-4425-8c89-e9079cd002c9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:26.243852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 537/1081] 10.222.0.55 () {56 vars in 1115 bytes} [Fri Sep 2 09:14:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:26.249950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5b746-ba06-4dd0-9c78-2471fe477119 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:26.290982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:26.346963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5b746-ba06-4dd0-9c78-2471fe477119 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:26.380247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de04eb-f236-4416-9d47-1d210cc634ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:26.380886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de04eb-f236-4416-9d47-1d210cc634ec None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:26.381183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de04eb-f236-4416-9d47-1d210cc634ec None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:26.381449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de04eb-f236-4416-9d47-1d210cc634ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:26.391631 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de04eb-f236-4416-9d47-1d210cc634ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:26.393142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de04eb-f236-4416-9d47-1d210cc634ec None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e2de04eb-f236-4416-9d47-1d210cc634ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:26.407330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:26.408331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:26.409766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:26.409766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:26.409766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:26.409766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 545/1082] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:26.414352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d4e1-f8ca-4425-8c89-e9079cd002c9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:26.459310 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:26.512138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d4e1-f8ca-4425-8c89-e9079cd002c9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:26.544447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e688c6a-4df6-47b4-94ef-63100fe3a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:26.545044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688c6a-4df6-47b4-94ef-63100fe3a998 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:26.545915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688c6a-4df6-47b4-94ef-63100fe3a998 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:26.546202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688c6a-4df6-47b4-94ef-63100fe3a998 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:26.546831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e688c6a-4df6-47b4-94ef-63100fe3a998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:26.547130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e688c6a-4df6-47b4-94ef-63100fe3a998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:26.548533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e688c6a-4df6-47b4-94ef-63100fe3a998 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:26.560456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 538/1083] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:26.566163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de04eb-f236-4416-9d47-1d210cc634ec None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:26.657700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:26.665951 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de04eb-f236-4416-9d47-1d210cc634ec None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:26.697908 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd856c8-f6de-485f-acac-d5ee28a1ff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:26.698530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd856c8-f6de-485f-acac-d5ee28a1ff94 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:26.698801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd856c8-f6de-485f-acac-d5ee28a1ff94 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:26.699068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd856c8-f6de-485f-acac-d5ee28a1ff94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:26.706677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd856c8-f6de-485f-acac-d5ee28a1ff94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:26.708119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd856c8-f6de-485f-acac-d5ee28a1ff94 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-5bd856c8-f6de-485f-acac-d5ee28a1ff94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:14:26.719585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:26.720565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:26.721542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 546/1084] 10.222.0.55 () {56 vars in 1093 bytes} [Fri Sep 2 09:14:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:26.726316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e688c6a-4df6-47b4-94ef-63100fe3a998 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:26.748496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8e51-356b-401a-92c0-135f972857e7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:26.748776 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8e51-356b-401a-92c0-135f972857e7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:26.749049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8e51-356b-401a-92c0-135f972857e7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:26.750372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 547/1085] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:14:26.755160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6064-bc0a-403d-8a6c-39a644931dcf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:26.755434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6064-bc0a-403d-8a6c-39a644931dcf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:26.755708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6064-bc0a-403d-8a6c-39a644931dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:26.773774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-46cc6064-bc0a-403d-8a6c-39a644931dcf None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:26.774947 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-46cc6064-bc0a-403d-8a6c-39a644931dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:26.829145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e688c6a-4df6-47b4-94ef-63100fe3a998 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:26.831409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:26.843401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 548/1086] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:26.862995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ff56b-6cf0-400a-ba7a-d6da2cc4b91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:26.863848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ff56b-6cf0-400a-ba7a-d6da2cc4b91c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:26.864155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ff56b-6cf0-400a-ba7a-d6da2cc4b91c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:26.864424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ff56b-6cf0-400a-ba7a-d6da2cc4b91c None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:26.865146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ff56b-6cf0-400a-ba7a-d6da2cc4b91c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:26.865443 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ff56b-6cf0-400a-ba7a-d6da2cc4b91c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:26.866860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ff56b-6cf0-400a-ba7a-d6da2cc4b91c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:26.884733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 539/1087] 10.222.0.55 () {56 vars in 1133 bytes} [Fri Sep 2 09:14:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:26.890962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc6064-bc0a-403d-8a6c-39a644931dcf None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:26.968880 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:26.985848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc6064-bc0a-403d-8a6c-39a644931dcf None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.020452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10709a-d8e4-4034-bc3e-4766356a60f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.021044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10709a-d8e4-4034-bc3e-4766356a60f4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.021318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10709a-d8e4-4034-bc3e-4766356a60f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.021585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10709a-d8e4-4034-bc3e-4766356a60f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.086038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10709a-d8e4-4034-bc3e-4766356a60f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:27.087468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10709a-d8e4-4034-bc3e-4766356a60f4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:27.106741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ff56b-6cf0-400a-ba7a-d6da2cc4b91c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:27.166144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:27.185558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 549/1088] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:14:27.199311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10709a-d8e4-4034-bc3e-4766356a60f4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:27.213063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ff56b-6cf0-400a-ba7a-d6da2cc4b91c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.245996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771a36-20ea-49c3-b4d3-6e7be0641205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.246550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771a36-20ea-49c3-b4d3-6e7be0641205 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.246822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771a36-20ea-49c3-b4d3-6e7be0641205 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.247091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771a36-20ea-49c3-b4d3-6e7be0641205 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.257939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7771a36-20ea-49c3-b4d3-6e7be0641205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f7771a36-20ea-49c3-b4d3-6e7be0641205 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:27.262814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:27.263728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:27.265289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 540/1089] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:27.270352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771a36-20ea-49c3-b4d3-6e7be0641205 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:27.288941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10709a-d8e4-4034-bc3e-4766356a60f4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.294265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:27.322256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34c6f7-9779-4fa3-8d11-8221433cecc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.322884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34c6f7-9779-4fa3-8d11-8221433cecc7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.323157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34c6f7-9779-4fa3-8d11-8221433cecc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.323427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34c6f7-9779-4fa3-8d11-8221433cecc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.333707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34c6f7-9779-4fa3-8d11-8221433cecc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:27.335136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34c6f7-9779-4fa3-8d11-8221433cecc7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4a34c6f7-9779-4fa3-8d11-8221433cecc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:14:27.349604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:27.350572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:14:27.351555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:14:27.351555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:14:27.351555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:27.351555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 550/1090] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:14:27.356296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34c6f7-9779-4fa3-8d11-8221433cecc7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:27.370154 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771a36-20ea-49c3-b4d3-6e7be0641205 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.390078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:27.404243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d601-96c5-4ac2-bfcf-2941b7ed3224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.408783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d601-96c5-4ac2-bfcf-2941b7ed3224 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.408783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d601-96c5-4ac2-bfcf-2941b7ed3224 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.408783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d601-96c5-4ac2-bfcf-2941b7ed3224 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.408783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03d601-96c5-4ac2-bfcf-2941b7ed3224 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:27.408783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03d601-96c5-4ac2-bfcf-2941b7ed3224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:27.408783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03d601-96c5-4ac2-bfcf-2941b7ed3224 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:27.415848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 541/1091] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:14:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:27.421718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d601-96c5-4ac2-bfcf-2941b7ed3224 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:27.456113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34c6f7-9779-4fa3-8d11-8221433cecc7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.488268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696031b6-5376-45e9-95b9-0d0d9693357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.488864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696031b6-5376-45e9-95b9-0d0d9693357b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.489137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696031b6-5376-45e9-95b9-0d0d9693357b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.489406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696031b6-5376-45e9-95b9-0d0d9693357b None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.490036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696031b6-5376-45e9-95b9-0d0d9693357b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:27.490337 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696031b6-5376-45e9-95b9-0d0d9693357b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:27.491676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696031b6-5376-45e9-95b9-0d0d9693357b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:27.503796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 551/1092] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:27.505299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:27.509338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696031b6-5376-45e9-95b9-0d0d9693357b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:27.521384 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d601-96c5-4ac2-bfcf-2941b7ed3224 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.555727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633fe90-0f24-4e67-9210-eea3adae8d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.556393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fe90-0f24-4e67-9210-eea3adae8d59 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.556672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fe90-0f24-4e67-9210-eea3adae8d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.556947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fe90-0f24-4e67-9210-eea3adae8d59 None admin] PATH_INFO: `/v3/users/8637f245ba5546fa82868500e0fc361d` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.558077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633fe90-0f24-4e67-9210-eea3adae8d59 None admin] RBAC: Authorizing `identity:get_user(user_id=8637f245ba5546fa82868500e0fc361d)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:27.559546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633fe90-0f24-4e67-9210-eea3adae8d59 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:27.561834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 542/1093] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:27 2022] GET /identity/v3/users/8637f245ba5546fa82868500e0fc361d => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:27.567427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633fe90-0f24-4e67-9210-eea3adae8d59 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:27.602317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:27.609256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696031b6-5376-45e9-95b9-0d0d9693357b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.642926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d326a-6253-4bc2-ab91-3e47159bc873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.643544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d326a-6253-4bc2-ab91-3e47159bc873 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.643820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d326a-6253-4bc2-ab91-3e47159bc873 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.644118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d326a-6253-4bc2-ab91-3e47159bc873 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.650708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d326a-6253-4bc2-ab91-3e47159bc873 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:27.652175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d326a-6253-4bc2-ab91-3e47159bc873 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-af9d326a-6253-4bc2-ab91-3e47159bc873 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:14:27.663184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:27.664103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:27.665009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:14:27.665009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:14:27.665009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:14:27.665009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:14:27.665009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:14:27.665009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:14:27.665009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:14:27.665009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:27.665009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 552/1094] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:27.665903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633fe90-0f24-4e67-9210-eea3adae8d59 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.670014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d326a-6253-4bc2-ab91-3e47159bc873 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:27.699802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f3c6a-62c3-47b7-988a-e0d4131353d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.700464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3c6a-62c3-47b7-988a-e0d4131353d9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.700745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3c6a-62c3-47b7-988a-e0d4131353d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.701013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3c6a-62c3-47b7-988a-e0d4131353d9 None admin] PATH_INFO: `/v3/projects/dafc00dce87c4d06b60fdc84020f11ef` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.702152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f3c6a-62c3-47b7-988a-e0d4131353d9 None admin] RBAC: Authorizing `identity:get_project(project_id=dafc00dce87c4d06b60fdc84020f11ef)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:27.703580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f3c6a-62c3-47b7-988a-e0d4131353d9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:27.705235 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 543/1095] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:14:27 2022] GET /identity/v3/projects/dafc00dce87c4d06b60fdc84020f11ef => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:27.710909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f3c6a-62c3-47b7-988a-e0d4131353d9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:27.732237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:27.767326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d326a-6253-4bc2-ab91-3e47159bc873 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.801712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2c534-5f42-4076-b7de-c5421ff9c152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.802318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2c534-5f42-4076-b7de-c5421ff9c152 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.802594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2c534-5f42-4076-b7de-c5421ff9c152 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.802870 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2c534-5f42-4076-b7de-c5421ff9c152 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.803552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2c534-5f42-4076-b7de-c5421ff9c152 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:27.803856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2c534-5f42-4076-b7de-c5421ff9c152 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:27.805303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2c534-5f42-4076-b7de-c5421ff9c152 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:27.808252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f3c6a-62c3-47b7-988a-e0d4131353d9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.816403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 553/1096] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:14:27.823491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2c534-5f42-4076-b7de-c5421ff9c152 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:27.840574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:27.843450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927c260-4bce-40b9-9ab0-1776cd054b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.844141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c260-4bce-40b9-9ab0-1776cd054b59 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.844417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c260-4bce-40b9-9ab0-1776cd054b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.844689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c260-4bce-40b9-9ab0-1776cd054b59 None admin] PATH_INFO: `/v3/projects/dafc00dce87c4d06b60fdc84020f11ef/users/8637f245ba5546fa82868500e0fc361d/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.846589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927c260-4bce-40b9-9ab0-1776cd054b59 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafc00dce87c4d06b60fdc84020f11ef, user_id=8637f245ba5546fa82868500e0fc361d, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:27.848057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927c260-4bce-40b9-9ab0-1776cd054b59 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:27.924676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2c534-5f42-4076-b7de-c5421ff9c152 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:27.953909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 544/1097] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:14:27 2022] PUT /identity/v3/projects/dafc00dce87c4d06b60fdc84020f11ef/users/8637f245ba5546fa82868500e0fc361d/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:14:27.956915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74f6ce-c74c-487a-a40c-73da94458e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:27.957527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74f6ce-c74c-487a-a40c-73da94458e6e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:27.957800 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74f6ce-c74c-487a-a40c-73da94458e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:27.958070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74f6ce-c74c-487a-a40c-73da94458e6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:27.958795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74f6ce-c74c-487a-a40c-73da94458e6e None admin] RBAC: Adding query filter params (role.id=ae7422720c0043d0b7f44c53804eac0c, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=5d74d78932554527a8bcb5880b2b9c96) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:27.959095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74f6ce-c74c-487a-a40c-73da94458e6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:27.960601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74f6ce-c74c-487a-a40c-73da94458e6e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:27.967858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 554/1098] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:14:27 2022] GET /identity/v3/role_assignments?user.id=5d74d78932554527a8bcb5880b2b9c96&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=ae7422720c0043d0b7f44c53804eac0c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:29.834825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54c36-14cb-4203-959b-29fc22a0e4ad None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:29.835352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54c36-14cb-4203-959b-29fc22a0e4ad None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:29.835352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54c36-14cb-4203-959b-29fc22a0e4ad None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:29.836721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 545/1099] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:29.841905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf97a-2ca1-4667-98fe-f6e3863e226c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:29.842272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf97a-2ca1-4667-98fe-f6e3863e226c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:29.842535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf97a-2ca1-4667-98fe-f6e3863e226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:29.860878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f90cf97a-2ca1-4667-98fe-f6e3863e226c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:29.862056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f90cf97a-2ca1-4667-98fe-f6e3863e226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:29.926080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 555/1100] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:30.188261 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54c36-14cb-4203-959b-29fc22a0e4ad None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:30.267328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:30.286183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54c36-14cb-4203-959b-29fc22a0e4ad None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:30.318868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce55e3-f12d-4ab6-9047-18449668a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:30.319467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce55e3-f12d-4ab6-9047-18449668a457 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:30.319737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce55e3-f12d-4ab6-9047-18449668a457 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:30.320037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce55e3-f12d-4ab6-9047-18449668a457 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:30.330477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce55e3-f12d-4ab6-9047-18449668a457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-38ce55e3-f12d-4ab6-9047-18449668a457 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:30.335733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:30.336837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:30.337998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 546/1101] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:30.342646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf97a-2ca1-4667-98fe-f6e3863e226c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:30.352650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:30.494613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf97a-2ca1-4667-98fe-f6e3863e226c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:30.527223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adee8fe-6c76-47d3-baaa-5aa7ac1a808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:30.527815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee8fe-6c76-47d3-baaa-5aa7ac1a808e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:30.528116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee8fe-6c76-47d3-baaa-5aa7ac1a808e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:30.528387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee8fe-6c76-47d3-baaa-5aa7ac1a808e None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:30.529037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adee8fe-6c76-47d3-baaa-5aa7ac1a808e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:30.529332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adee8fe-6c76-47d3-baaa-5aa7ac1a808e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:30.530757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adee8fe-6c76-47d3-baaa-5aa7ac1a808e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:30.538418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 556/1102] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:30.544168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce55e3-f12d-4ab6-9047-18449668a457 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:30.641159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce55e3-f12d-4ab6-9047-18449668a457 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:30.673407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1a801-9440-43a6-a391-94b2fbcb2dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:30.674015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a801-9440-43a6-a391-94b2fbcb2dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:30.674291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a801-9440-43a6-a391-94b2fbcb2dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:30.674562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a801-9440-43a6-a391-94b2fbcb2dc0 None admin] PATH_INFO: `/v3/users/8637f245ba5546fa82868500e0fc361d` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:30.675670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1a801-9440-43a6-a391-94b2fbcb2dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=8637f245ba5546fa82868500e0fc361d)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:30.677125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1a801-9440-43a6-a391-94b2fbcb2dc0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:30.678664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 547/1103] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:30 2022] GET /identity/v3/users/8637f245ba5546fa82868500e0fc361d => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:30.684402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adee8fe-6c76-47d3-baaa-5aa7ac1a808e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:30.751703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:30.781517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adee8fe-6c76-47d3-baaa-5aa7ac1a808e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:30.813722 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a412ba-bba7-438f-8477-82d1cc210a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:30.814309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a412ba-bba7-438f-8477-82d1cc210a4c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:30.814584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a412ba-bba7-438f-8477-82d1cc210a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:30.814852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a412ba-bba7-438f-8477-82d1cc210a4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:30.884883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a412ba-bba7-438f-8477-82d1cc210a4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:30.886333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a412ba-bba7-438f-8477-82d1cc210a4c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:30.950511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:30.980249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 557/1104] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:14:30.986951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1a801-9440-43a6-a391-94b2fbcb2dc0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:30.998341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:31.083347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1a801-9440-43a6-a391-94b2fbcb2dc0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:31.116224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7255b-7d9b-4143-bb26-a877f753ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:31.116843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7255b-7d9b-4143-bb26-a877f753ebbc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:31.117121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7255b-7d9b-4143-bb26-a877f753ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:31.117394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7255b-7d9b-4143-bb26-a877f753ebbc None admin] PATH_INFO: `/v3/projects/dafc00dce87c4d06b60fdc84020f11ef` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:31.118494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7255b-7d9b-4143-bb26-a877f753ebbc None admin] RBAC: Authorizing `identity:get_project(project_id=dafc00dce87c4d06b60fdc84020f11ef)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:31.119956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7255b-7d9b-4143-bb26-a877f753ebbc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:31.121560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 548/1105] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:14:30 2022] GET /identity/v3/projects/dafc00dce87c4d06b60fdc84020f11ef => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:31.127937 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a412ba-bba7-438f-8477-82d1cc210a4c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:31.227420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a412ba-bba7-438f-8477-82d1cc210a4c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:31.261094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d507c-087e-4541-9229-662bd66fd7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:31.261689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d507c-087e-4541-9229-662bd66fd7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:31.261964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d507c-087e-4541-9229-662bd66fd7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:31.262235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d507c-087e-4541-9229-662bd66fd7d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:31.262948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d507c-087e-4541-9229-662bd66fd7d3 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=dafc00dce87c4d06b60fdc84020f11ef, user.id=8637f245ba5546fa82868500e0fc361d) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:31.263252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d507c-087e-4541-9229-662bd66fd7d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:31.265178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d507c-087e-4541-9229-662bd66fd7d3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:31.270696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 558/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:14:31 2022] GET /identity/v3/role_assignments?user.id=8637f245ba5546fa82868500e0fc361d&scope.project.id=dafc00dce87c4d06b60fdc84020f11ef&role.id=04d1bc62091440e189989e4b973a6627 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:33.175377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331c508-0ef3-41df-ae5e-58bc296109a4 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:33.175914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331c508-0ef3-41df-ae5e-58bc296109a4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:33.175914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331c508-0ef3-41df-ae5e-58bc296109a4 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:33.177211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 549/1107] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:33.182435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ffc97-73a3-4c3c-a816-baef131fe2d5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:33.182853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ffc97-73a3-4c3c-a816-baef131fe2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:33.182959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ffc97-73a3-4c3c-a816-baef131fe2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:33.201176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-812ffc97-73a3-4c3c-a816-baef131fe2d5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:33.202967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-812ffc97-73a3-4c3c-a816-baef131fe2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:33.228342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:33.266617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 559/1108] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:33.531170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331c508-0ef3-41df-ae5e-58bc296109a4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:33.606027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:33.630255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331c508-0ef3-41df-ae5e-58bc296109a4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:33.662568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d1d98-c7b6-499b-a41b-c825fca8df21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:33.663180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d1d98-c7b6-499b-a41b-c825fca8df21 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:33.663453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d1d98-c7b6-499b-a41b-c825fca8df21 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:33.663721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d1d98-c7b6-499b-a41b-c825fca8df21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:33.664835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d1d98-c7b6-499b-a41b-c825fca8df21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:33.666256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d1d98-c7b6-499b-a41b-c825fca8df21 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:33.667782 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 550/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:33.673894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ffc97-73a3-4c3c-a816-baef131fe2d5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:33.767297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ffc97-73a3-4c3c-a816-baef131fe2d5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:33.799910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9406975-1173-4a60-a198-210cf3acd582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:33.800449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9406975-1173-4a60-a198-210cf3acd582 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:33.800748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9406975-1173-4a60-a198-210cf3acd582 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:33.801015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9406975-1173-4a60-a198-210cf3acd582 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:33.801658 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9406975-1173-4a60-a198-210cf3acd582 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:33.803067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9406975-1173-4a60-a198-210cf3acd582 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:33.880524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 560/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:14:33 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:14:35.798213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647b8a0-5a07-410d-9ac8-de3920e4c494 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:35.798741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647b8a0-5a07-410d-9ac8-de3920e4c494 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:35.798741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647b8a0-5a07-410d-9ac8-de3920e4c494 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:35.800116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 551/1111] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:35.805323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bc6d1-3970-4783-9369-feef38ee4a73 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:35.805740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bc6d1-3970-4783-9369-feef38ee4a73 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:35.805869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bc6d1-3970-4783-9369-feef38ee4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:35.824369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1b0bc6d1-3970-4783-9369-feef38ee4a73 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:35.825552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1b0bc6d1-3970-4783-9369-feef38ee4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:35.839735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:35.890334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 561/1112] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:36.159051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647b8a0-5a07-410d-9ac8-de3920e4c494 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:36.258059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647b8a0-5a07-410d-9ac8-de3920e4c494 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:36.289905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104b948-2fa2-4496-b079-ef500b0cc3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:36.290518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104b948-2fa2-4496-b079-ef500b0cc3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:36.290791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104b948-2fa2-4496-b079-ef500b0cc3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:36.291116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104b948-2fa2-4496-b079-ef500b0cc3c1 None admin] PATH_INFO: `/v3/roles/5691b81a7afd45eca087af3298e82784` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:36.292549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104b948-2fa2-4496-b079-ef500b0cc3c1 None admin] RBAC: Authorizing `identity:get_role(role_id=5691b81a7afd45eca087af3298e82784)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:36.293935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104b948-2fa2-4496-b079-ef500b0cc3c1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:36.295230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 552/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:36 2022] GET /identity/v3/roles/5691b81a7afd45eca087af3298e82784 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:36.301523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bc6d1-3970-4783-9369-feef38ee4a73 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:36.398326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bc6d1-3970-4783-9369-feef38ee4a73 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:36.431824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c6ba0-bf8d-45c6-85fb-96c857d06550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:36.432416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c6ba0-bf8d-45c6-85fb-96c857d06550 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:36.432691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c6ba0-bf8d-45c6-85fb-96c857d06550 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:36.432964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c6ba0-bf8d-45c6-85fb-96c857d06550 None admin] PATH_INFO: `/v3/users/3f7833d0546842b08a6d27a78d21dbb2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:36.445708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c6ba0-bf8d-45c6-85fb-96c857d06550 None admin] RBAC: Authorizing `identity:get_user(user_id=3f7833d0546842b08a6d27a78d21dbb2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:36.447146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c6ba0-bf8d-45c6-85fb-96c857d06550 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:36.448762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 562/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:36 2022] GET /identity/v3/users/3f7833d0546842b08a6d27a78d21dbb2 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:36.454964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104b948-2fa2-4496-b079-ef500b0cc3c1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:36.470319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:36.551742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104b948-2fa2-4496-b079-ef500b0cc3c1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:36.584047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c593e9-66a1-4a4f-bb6d-2a99a915c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:36.584631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c593e9-66a1-4a4f-bb6d-2a99a915c75d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:36.584903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c593e9-66a1-4a4f-bb6d-2a99a915c75d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:36.585172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c593e9-66a1-4a4f-bb6d-2a99a915c75d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:36.649552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c593e9-66a1-4a4f-bb6d-2a99a915c75d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:36.650981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c593e9-66a1-4a4f-bb6d-2a99a915c75d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:36.664227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:36.744896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 553/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:14:36.751532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c6ba0-bf8d-45c6-85fb-96c857d06550 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:36.762015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:36.848887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c6ba0-bf8d-45c6-85fb-96c857d06550 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:36.881903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b7c1d-e62d-40a9-afd3-ce5be6dcb5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:36.882528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b7c1d-e62d-40a9-afd3-ce5be6dcb5ba None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:36.882807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b7c1d-e62d-40a9-afd3-ce5be6dcb5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:36.883081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b7c1d-e62d-40a9-afd3-ce5be6dcb5ba None admin] PATH_INFO: `/v3/projects/dafc00dce87c4d06b60fdc84020f11ef` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:36.884215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b7c1d-e62d-40a9-afd3-ce5be6dcb5ba None admin] RBAC: Authorizing `identity:get_project(project_id=dafc00dce87c4d06b60fdc84020f11ef)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:36.885638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b7c1d-e62d-40a9-afd3-ce5be6dcb5ba None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:36.887256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 563/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:14:36 2022] GET /identity/v3/projects/dafc00dce87c4d06b60fdc84020f11ef => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:36.894030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c593e9-66a1-4a4f-bb6d-2a99a915c75d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:36.988672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c593e9-66a1-4a4f-bb6d-2a99a915c75d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:37.002077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:37.022619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a377c5-cde5-4d6a-8e53-579b67e26c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:37.023203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a377c5-cde5-4d6a-8e53-579b67e26c3f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:37.023478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a377c5-cde5-4d6a-8e53-579b67e26c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:37.023748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a377c5-cde5-4d6a-8e53-579b67e26c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:37.024484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a377c5-cde5-4d6a-8e53-579b67e26c3f None admin] RBAC: Adding query filter params (role.id=5691b81a7afd45eca087af3298e82784, scope.project.id=dafc00dce87c4d06b60fdc84020f11ef, user.id=3f7833d0546842b08a6d27a78d21dbb2) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:37.024785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a377c5-cde5-4d6a-8e53-579b67e26c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:37.026199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a377c5-cde5-4d6a-8e53-579b67e26c3f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:37.031770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 554/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:14:36 2022] GET /identity/v3/role_assignments?user.id=3f7833d0546842b08a6d27a78d21dbb2&scope.project.id=dafc00dce87c4d06b60fdc84020f11ef&role.id=5691b81a7afd45eca087af3298e82784 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:38.883792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07e9c7-55a5-444f-9efc-d4c38439a8ee None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:38.884296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07e9c7-55a5-444f-9efc-d4c38439a8ee None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:38.884389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07e9c7-55a5-444f-9efc-d4c38439a8ee None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:38.885705 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 564/1118] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:38.890846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cff148-0976-4d91-9285-51c249827f4e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:38.891240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cff148-0976-4d91-9285-51c249827f4e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:38.891400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cff148-0976-4d91-9285-51c249827f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:38.909335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a4cff148-0976-4d91-9285-51c249827f4e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:38.910508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a4cff148-0976-4d91-9285-51c249827f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:38.974156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 555/1119] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:39.244246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07e9c7-55a5-444f-9efc-d4c38439a8ee None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:39.319072 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:39.341005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07e9c7-55a5-444f-9efc-d4c38439a8ee None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:39.374024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070ba5c-4388-432d-93a9-fe6f1edbdfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:39.374655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070ba5c-4388-432d-93a9-fe6f1edbdfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:39.374926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070ba5c-4388-432d-93a9-fe6f1edbdfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:39.375191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070ba5c-4388-432d-93a9-fe6f1edbdfb4 None admin] PATH_INFO: `/v3/roles/5691b81a7afd45eca087af3298e82784` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:39.376572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070ba5c-4388-432d-93a9-fe6f1edbdfb4 None admin] RBAC: Authorizing `identity:get_role(role_id=5691b81a7afd45eca087af3298e82784)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:39.377913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070ba5c-4388-432d-93a9-fe6f1edbdfb4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:39.379200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 565/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:39 2022] GET /identity/v3/roles/5691b81a7afd45eca087af3298e82784 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:39.384874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cff148-0976-4d91-9285-51c249827f4e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:39.480119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cff148-0976-4d91-9285-51c249827f4e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:39.487625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:39.513356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb89ae-a7cb-4542-8b0a-ad59a2b1ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:39.513910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb89ae-a7cb-4542-8b0a-ad59a2b1ae4b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:39.514182 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb89ae-a7cb-4542-8b0a-ad59a2b1ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:39.514448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb89ae-a7cb-4542-8b0a-ad59a2b1ae4b None admin] PATH_INFO: `/v3/users/3f7833d0546842b08a6d27a78d21dbb2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:39.516044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb89ae-a7cb-4542-8b0a-ad59a2b1ae4b None admin] RBAC: Authorizing `identity:get_user(user_id=3f7833d0546842b08a6d27a78d21dbb2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:39.517455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb89ae-a7cb-4542-8b0a-ad59a2b1ae4b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:39.518993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 556/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:39 2022] GET /identity/v3/users/3f7833d0546842b08a6d27a78d21dbb2 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:39.524549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070ba5c-4388-432d-93a9-fe6f1edbdfb4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:39.618701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070ba5c-4388-432d-93a9-fe6f1edbdfb4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:39.650996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75483561-128d-43d3-abbb-9d75e0ca3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:39.651596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75483561-128d-43d3-abbb-9d75e0ca3fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:39.651867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75483561-128d-43d3-abbb-9d75e0ca3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:39.652161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75483561-128d-43d3-abbb-9d75e0ca3fd5 None admin] PATH_INFO: `/v3/projects/dafc00dce87c4d06b60fdc84020f11ef` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:39.653240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75483561-128d-43d3-abbb-9d75e0ca3fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=dafc00dce87c4d06b60fdc84020f11ef)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:39.654636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75483561-128d-43d3-abbb-9d75e0ca3fd5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:39.656826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 566/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:14:39 2022] GET /identity/v3/projects/dafc00dce87c4d06b60fdc84020f11ef => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:39.662467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb89ae-a7cb-4542-8b0a-ad59a2b1ae4b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:39.757924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb89ae-a7cb-4542-8b0a-ad59a2b1ae4b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:39.790219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37692e0-c381-4ee7-8785-f3ed7290c51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:39.790847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37692e0-c381-4ee7-8785-f3ed7290c51e None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:39.791118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37692e0-c381-4ee7-8785-f3ed7290c51e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:39.791383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37692e0-c381-4ee7-8785-f3ed7290c51e None admin] PATH_INFO: `/v3/projects/dafc00dce87c4d06b60fdc84020f11ef/users/3f7833d0546842b08a6d27a78d21dbb2/roles/5691b81a7afd45eca087af3298e82784` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:39.793449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37692e0-c381-4ee7-8785-f3ed7290c51e None admin] RBAC: Authorizing `identity:create_grant(project_id=dafc00dce87c4d06b60fdc84020f11ef, user_id=3f7833d0546842b08a6d27a78d21dbb2, role_id=5691b81a7afd45eca087af3298e82784)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:39.794879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37692e0-c381-4ee7-8785-f3ed7290c51e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:39.868764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 557/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:14:39 2022] PUT /identity/v3/projects/dafc00dce87c4d06b60fdc84020f11ef/users/3f7833d0546842b08a6d27a78d21dbb2/roles/5691b81a7afd45eca087af3298e82784 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:14:41.708520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9f662-24c8-43cc-92e3-4534b10022cb None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:41.709100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9f662-24c8-43cc-92e3-4534b10022cb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:41.709100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9f662-24c8-43cc-92e3-4534b10022cb None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:41.710380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 567/1124] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:41.715417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ced76c-95ae-4deb-b8a0-657cf96d79d2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:41.715851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ced76c-95ae-4deb-b8a0-657cf96d79d2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:41.715975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ced76c-95ae-4deb-b8a0-657cf96d79d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:41.733453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e1ced76c-95ae-4deb-b8a0-657cf96d79d2 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:41.735100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e1ced76c-95ae-4deb-b8a0-657cf96d79d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:41.761263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:41.799120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 558/1125] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:14:42.063318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9f662-24c8-43cc-92e3-4534b10022cb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:42.078366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:42.161703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9f662-24c8-43cc-92e3-4534b10022cb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:42.193874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f0415-2bee-473b-a5df-61a18ad47b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:42.194484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f0415-2bee-473b-a5df-61a18ad47b57 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:42.194761 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f0415-2bee-473b-a5df-61a18ad47b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:42.195033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f0415-2bee-473b-a5df-61a18ad47b57 None admin] PATH_INFO: `/v3/roles/5691b81a7afd45eca087af3298e82784` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:42.196432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f0415-2bee-473b-a5df-61a18ad47b57 None admin] RBAC: Authorizing `identity:get_role(role_id=5691b81a7afd45eca087af3298e82784)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:42.197795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f0415-2bee-473b-a5df-61a18ad47b57 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:42.199083 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 568/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:42 2022] GET /identity/v3/roles/5691b81a7afd45eca087af3298e82784 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:42.205452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ced76c-95ae-4deb-b8a0-657cf96d79d2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:42.300717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ced76c-95ae-4deb-b8a0-657cf96d79d2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:42.333758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9f67d-f5d6-4951-9a07-5d8237d74add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:42.334321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f67d-f5d6-4951-9a07-5d8237d74add None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:42.334595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f67d-f5d6-4951-9a07-5d8237d74add None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:42.334865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f67d-f5d6-4951-9a07-5d8237d74add None admin] PATH_INFO: `/v3/users/3f7833d0546842b08a6d27a78d21dbb2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:42.335993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9f67d-f5d6-4951-9a07-5d8237d74add None admin] RBAC: Authorizing `identity:get_user(user_id=3f7833d0546842b08a6d27a78d21dbb2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:42.337426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9f67d-f5d6-4951-9a07-5d8237d74add None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:42.338972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 559/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:42 2022] GET /identity/v3/users/3f7833d0546842b08a6d27a78d21dbb2 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:42.344715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f0415-2bee-473b-a5df-61a18ad47b57 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:42.422193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:42.440600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f0415-2bee-473b-a5df-61a18ad47b57 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:42.472860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea23e30-f74e-4808-9d32-ebde9e149a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:42.473449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea23e30-f74e-4808-9d32-ebde9e149a54 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:42.473723 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea23e30-f74e-4808-9d32-ebde9e149a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:42.473991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea23e30-f74e-4808-9d32-ebde9e149a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:42.538860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea23e30-f74e-4808-9d32-ebde9e149a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:42.540325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea23e30-f74e-4808-9d32-ebde9e149a54 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:42.615266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:42.634475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 569/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:14:42.640403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9f67d-f5d6-4951-9a07-5d8237d74add None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:42.670150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:42.736571 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9f67d-f5d6-4951-9a07-5d8237d74add None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:42.768774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7427e1-4beb-4526-910f-5559129540d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:42.769382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7427e1-4beb-4526-910f-5559129540d9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:42.769655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7427e1-4beb-4526-910f-5559129540d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:42.769929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7427e1-4beb-4526-910f-5559129540d9 None admin] PATH_INFO: `/v3/projects/dafc00dce87c4d06b60fdc84020f11ef` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:42.771023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7427e1-4beb-4526-910f-5559129540d9 None admin] RBAC: Authorizing `identity:get_project(project_id=dafc00dce87c4d06b60fdc84020f11ef)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:42.772481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7427e1-4beb-4526-910f-5559129540d9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:42.774065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 560/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:14:42 2022] GET /identity/v3/projects/dafc00dce87c4d06b60fdc84020f11ef => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:42.780068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea23e30-f74e-4808-9d32-ebde9e149a54 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:42.877089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea23e30-f74e-4808-9d32-ebde9e149a54 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:42.910240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086cac7-f858-4d3d-8908-c418110b3c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:42.910829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086cac7-f858-4d3d-8908-c418110b3c87 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:42.911100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086cac7-f858-4d3d-8908-c418110b3c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:42.911365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086cac7-f858-4d3d-8908-c418110b3c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:42.912098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086cac7-f858-4d3d-8908-c418110b3c87 None admin] RBAC: Adding query filter params (role.id=5691b81a7afd45eca087af3298e82784, scope.project.id=dafc00dce87c4d06b60fdc84020f11ef, user.id=3f7833d0546842b08a6d27a78d21dbb2) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:42.912397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086cac7-f858-4d3d-8908-c418110b3c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:42.913802 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086cac7-f858-4d3d-8908-c418110b3c87 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:42.919253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 570/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:14:42 2022] GET /identity/v3/role_assignments?user.id=3f7833d0546842b08a6d27a78d21dbb2&scope.project.id=dafc00dce87c4d06b60fdc84020f11ef&role.id=5691b81a7afd45eca087af3298e82784 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:44.813556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460531a3-cfe1-4394-8168-2d9acfdacc9e None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:44.814115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460531a3-cfe1-4394-8168-2d9acfdacc9e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:44.814115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460531a3-cfe1-4394-8168-2d9acfdacc9e None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:44.815431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 561/1131] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:44.820644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e42b67-6ba6-48b4-9762-3afd0d09680a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:44.821091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e42b67-6ba6-48b4-9762-3afd0d09680a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:44.821191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e42b67-6ba6-48b4-9762-3afd0d09680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:44.844235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-80e42b67-6ba6-48b4-9762-3afd0d09680a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:44.845438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-80e42b67-6ba6-48b4-9762-3afd0d09680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:44.884090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:44.910493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 571/1132] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:45.175577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460531a3-cfe1-4394-8168-2d9acfdacc9e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:45.270602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:45.274226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460531a3-cfe1-4394-8168-2d9acfdacc9e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:45.306264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be270e-6e99-4cd4-a001-979cb70d2696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:45.306873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be270e-6e99-4cd4-a001-979cb70d2696 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:45.307145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be270e-6e99-4cd4-a001-979cb70d2696 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:45.307412 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be270e-6e99-4cd4-a001-979cb70d2696 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:45.308518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be270e-6e99-4cd4-a001-979cb70d2696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:45.309934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be270e-6e99-4cd4-a001-979cb70d2696 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:45.311460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 562/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:45.317624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e42b67-6ba6-48b4-9762-3afd0d09680a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:45.412819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e42b67-6ba6-48b4-9762-3afd0d09680a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:45.446023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcac095-b450-432a-855f-e518d758d47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:45.446561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcac095-b450-432a-855f-e518d758d47f None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:45.446837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcac095-b450-432a-855f-e518d758d47f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:45.447107 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcac095-b450-432a-855f-e518d758d47f None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:45.447738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcac095-b450-432a-855f-e518d758d47f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:45.449187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcac095-b450-432a-855f-e518d758d47f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:45.527281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 572/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:14:45 2022] POST /identity/v3/projects => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:47.428997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae410eb-4575-4991-9620-ed71cfd9f3a0 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:47.429555 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae410eb-4575-4991-9620-ed71cfd9f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:47.429555 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae410eb-4575-4991-9620-ed71cfd9f3a0 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:47.430861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 563/1135] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:47.435948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5cf6e-d18c-4be7-8165-3ca198f40792 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:47.436339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5cf6e-d18c-4be7-8165-3ca198f40792 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:47.436498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5cf6e-d18c-4be7-8165-3ca198f40792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:47.455273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1dd5cf6e-d18c-4be7-8165-3ca198f40792 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:47.456472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1dd5cf6e-d18c-4be7-8165-3ca198f40792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:47.475656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:47.521576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 573/1136] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:47.788995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae410eb-4575-4991-9620-ed71cfd9f3a0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:47.889988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae410eb-4575-4991-9620-ed71cfd9f3a0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:47.923320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed2296-9d8f-42a7-be97-3bb78cb322ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:47.924003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed2296-9d8f-42a7-be97-3bb78cb322ac None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:47.924284 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed2296-9d8f-42a7-be97-3bb78cb322ac None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:47.924557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed2296-9d8f-42a7-be97-3bb78cb322ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:47.925695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed2296-9d8f-42a7-be97-3bb78cb322ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:47.927128 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed2296-9d8f-42a7-be97-3bb78cb322ac None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:47.928734 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 564/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:14:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:47.934454 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5cf6e-d18c-4be7-8165-3ca198f40792 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:48.030309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5cf6e-d18c-4be7-8165-3ca198f40792 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:48.063680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd3f42-1672-471a-a252-525140448daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:48.064241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd3f42-1672-471a-a252-525140448daa None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:48.064519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd3f42-1672-471a-a252-525140448daa None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:48.064787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd3f42-1672-471a-a252-525140448daa None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:48.065424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd3f42-1672-471a-a252-525140448daa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:48.066843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd3f42-1672-471a-a252-525140448daa None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:48.166587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 574/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:14:47 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:14:50.090502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fefd33-c15c-4d03-874c-3a1076b5425a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:50.091016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fefd33-c15c-4d03-874c-3a1076b5425a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:50.091016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fefd33-c15c-4d03-874c-3a1076b5425a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:50.092341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 565/1139] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:50.097512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3266e4-fb39-43f8-88f6-cde8423e89cd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:50.097920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3266e4-fb39-43f8-88f6-cde8423e89cd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:50.098054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3266e4-fb39-43f8-88f6-cde8423e89cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:50.116256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7b3266e4-fb39-43f8-88f6-cde8423e89cd None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:50.117429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7b3266e4-fb39-43f8-88f6-cde8423e89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:50.124416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:50.181037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 575/1140] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:50.451591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fefd33-c15c-4d03-874c-3a1076b5425a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:50.487375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:50.550968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fefd33-c15c-4d03-874c-3a1076b5425a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:50.582968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9d7d-38dc-40b4-8a82-ac6181bb103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:50.583581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9d7d-38dc-40b4-8a82-ac6181bb103a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:50.583864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9d7d-38dc-40b4-8a82-ac6181bb103a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:50.584167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9d7d-38dc-40b4-8a82-ac6181bb103a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:50.594375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e9d7d-38dc-40b4-8a82-ac6181bb103a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-727e9d7d-38dc-40b4-8a82-ac6181bb103a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:50.599160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:50.600325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:50.601541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 566/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:50.606077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3266e4-fb39-43f8-88f6-cde8423e89cd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:50.700683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3266e4-fb39-43f8-88f6-cde8423e89cd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:50.735500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc6bfd-d939-4cc1-86fe-c088195f04fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:50.736070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc6bfd-d939-4cc1-86fe-c088195f04fb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:50.736349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc6bfd-d939-4cc1-86fe-c088195f04fb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:50.736617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc6bfd-d939-4cc1-86fe-c088195f04fb None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:50.737264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc6bfd-d939-4cc1-86fe-c088195f04fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:50.737563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc6bfd-d939-4cc1-86fe-c088195f04fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:50.738918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc6bfd-d939-4cc1-86fe-c088195f04fb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:50.746603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 576/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:14:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:50.752467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9d7d-38dc-40b4-8a82-ac6181bb103a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:50.843637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:50.849986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9d7d-38dc-40b4-8a82-ac6181bb103a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:50.882869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fcfda-63ad-464d-a9d4-9c37c4513419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:50.883488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fcfda-63ad-464d-a9d4-9c37c4513419 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:50.883766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fcfda-63ad-464d-a9d4-9c37c4513419 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:50.884068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fcfda-63ad-464d-a9d4-9c37c4513419 None admin] PATH_INFO: `/v3/users/2e2bdb0ed1b94b6e97a0bf4b061d5f19` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:50.897160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fcfda-63ad-464d-a9d4-9c37c4513419 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2bdb0ed1b94b6e97a0bf4b061d5f19)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:50.898602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fcfda-63ad-464d-a9d4-9c37c4513419 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:50.900209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 567/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:50 2022] GET /identity/v3/users/2e2bdb0ed1b94b6e97a0bf4b061d5f19 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:50.906142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc6bfd-d939-4cc1-86fe-c088195f04fb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:50.910411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:51.002487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc6bfd-d939-4cc1-86fe-c088195f04fb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:51.034520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e7693-45ba-446e-a9e8-59d69602706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:51.035105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7693-45ba-446e-a9e8-59d69602706c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:51.035379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7693-45ba-446e-a9e8-59d69602706c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:51.035649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7693-45ba-446e-a9e8-59d69602706c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:51.099154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e7693-45ba-446e-a9e8-59d69602706c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:51.100603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e7693-45ba-446e-a9e8-59d69602706c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:51.103019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:51.192645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 577/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:14:51.198654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fcfda-63ad-464d-a9d4-9c37c4513419 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:51.294671 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fcfda-63ad-464d-a9d4-9c37c4513419 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:51.327372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e357f-3b7f-41c6-9db8-fe9eb2080902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:51.328011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e357f-3b7f-41c6-9db8-fe9eb2080902 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:51.328845 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e357f-3b7f-41c6-9db8-fe9eb2080902 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:51.329128 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e357f-3b7f-41c6-9db8-fe9eb2080902 None admin] PATH_INFO: `/v3/projects/c5b7d6ba7cac4ef7b22269246343b2eb` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:51.330225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e357f-3b7f-41c6-9db8-fe9eb2080902 None admin] RBAC: Authorizing `identity:get_project(project_id=c5b7d6ba7cac4ef7b22269246343b2eb)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:51.331635 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e357f-3b7f-41c6-9db8-fe9eb2080902 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:51.333243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 568/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:14:51 2022] GET /identity/v3/projects/c5b7d6ba7cac4ef7b22269246343b2eb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:51.339130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e7693-45ba-446e-a9e8-59d69602706c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:51.433514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e7693-45ba-446e-a9e8-59d69602706c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:51.435737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:51.465822 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ff03f-05a8-435f-82e3-d493c0f06392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:51.466414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff03f-05a8-435f-82e3-d493c0f06392 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:51.466689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff03f-05a8-435f-82e3-d493c0f06392 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:51.466956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff03f-05a8-435f-82e3-d493c0f06392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:51.467661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff03f-05a8-435f-82e3-d493c0f06392 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=c5b7d6ba7cac4ef7b22269246343b2eb, user.id=2e2bdb0ed1b94b6e97a0bf4b061d5f19) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:51.467996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff03f-05a8-435f-82e3-d493c0f06392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:51.469416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff03f-05a8-435f-82e3-d493c0f06392 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:51.475200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 578/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:14:51 2022] GET /identity/v3/role_assignments?user.id=2e2bdb0ed1b94b6e97a0bf4b061d5f19&scope.project.id=c5b7d6ba7cac4ef7b22269246343b2eb&role.id=04d1bc62091440e189989e4b973a6627 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:53.333965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac345ee9-1288-4b3d-acb0-4e5bfa7e4b75 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:53.334479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac345ee9-1288-4b3d-acb0-4e5bfa7e4b75 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:53.334570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac345ee9-1288-4b3d-acb0-4e5bfa7e4b75 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:53.335843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 569/1147] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:53.340940 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571229e9-2cb3-44b4-9e50-95a2de5b96d4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:53.341360 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571229e9-2cb3-44b4-9e50-95a2de5b96d4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:53.341464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571229e9-2cb3-44b4-9e50-95a2de5b96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:53.360237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-571229e9-2cb3-44b4-9e50-95a2de5b96d4 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:53.361426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-571229e9-2cb3-44b4-9e50-95a2de5b96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:53.424946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 579/1148] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:53.690890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac345ee9-1288-4b3d-acb0-4e5bfa7e4b75 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:53.714816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:53.788999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac345ee9-1288-4b3d-acb0-4e5bfa7e4b75 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:53.821088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db586-d55f-4557-b08c-b0f83cb24495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:53.821709 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db586-d55f-4557-b08c-b0f83cb24495 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:53.821984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db586-d55f-4557-b08c-b0f83cb24495 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:53.822258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db586-d55f-4557-b08c-b0f83cb24495 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:53.833055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931db586-d55f-4557-b08c-b0f83cb24495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-931db586-d55f-4557-b08c-b0f83cb24495 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:53.837848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:53.838777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:53.839615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:14:53.843875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 570/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:14:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:53.845531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571229e9-2cb3-44b4-9e50-95a2de5b96d4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:53.935633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:53.939127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571229e9-2cb3-44b4-9e50-95a2de5b96d4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:53.972032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e9bce-c743-442f-9484-9d0c9374f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:53.972563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e9bce-c743-442f-9484-9d0c9374f8ee None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:53.972835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e9bce-c743-442f-9484-9d0c9374f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:53.973101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e9bce-c743-442f-9484-9d0c9374f8ee None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:53.973740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e9bce-c743-442f-9484-9d0c9374f8ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:53.974032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e9bce-c743-442f-9484-9d0c9374f8ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:53.975508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e9bce-c743-442f-9484-9d0c9374f8ee None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:53.983429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 580/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:53.989199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db586-d55f-4557-b08c-b0f83cb24495 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:54.069699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:54.087500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db586-d55f-4557-b08c-b0f83cb24495 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:54.120314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f3f06-6300-4ab6-88b5-f4d7cb511b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:54.120920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f3f06-6300-4ab6-88b5-f4d7cb511b6c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:54.121196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f3f06-6300-4ab6-88b5-f4d7cb511b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:54.121468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f3f06-6300-4ab6-88b5-f4d7cb511b6c None admin] PATH_INFO: `/v3/users/2e2bdb0ed1b94b6e97a0bf4b061d5f19` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:54.122575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f3f06-6300-4ab6-88b5-f4d7cb511b6c None admin] RBAC: Authorizing `identity:get_user(user_id=2e2bdb0ed1b94b6e97a0bf4b061d5f19)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:54.124009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f3f06-6300-4ab6-88b5-f4d7cb511b6c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:54.126333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 571/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:53 2022] GET /identity/v3/users/2e2bdb0ed1b94b6e97a0bf4b061d5f19 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:54.132001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e9bce-c743-442f-9484-9d0c9374f8ee None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:54.227409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e9bce-c743-442f-9484-9d0c9374f8ee None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:54.259526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e8b0f-b4d6-4f37-8dd9-2356d80edad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:54.260159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e8b0f-b4d6-4f37-8dd9-2356d80edad4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:54.260432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e8b0f-b4d6-4f37-8dd9-2356d80edad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:54.260700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e8b0f-b4d6-4f37-8dd9-2356d80edad4 None admin] PATH_INFO: `/v3/projects/c5b7d6ba7cac4ef7b22269246343b2eb` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:54.261797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e8b0f-b4d6-4f37-8dd9-2356d80edad4 None admin] RBAC: Authorizing `identity:get_project(project_id=c5b7d6ba7cac4ef7b22269246343b2eb)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:54.263205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e8b0f-b4d6-4f37-8dd9-2356d80edad4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:54.264815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 581/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:14:54 2022] GET /identity/v3/projects/c5b7d6ba7cac4ef7b22269246343b2eb => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:54.271136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f3f06-6300-4ab6-88b5-f4d7cb511b6c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:54.365275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f3f06-6300-4ab6-88b5-f4d7cb511b6c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:54.397630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be58df-34d3-46ef-bc14-03fb4f78ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:54.398264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be58df-34d3-46ef-bc14-03fb4f78ced0 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:54.398534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be58df-34d3-46ef-bc14-03fb4f78ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:54.398797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be58df-34d3-46ef-bc14-03fb4f78ced0 None admin] PATH_INFO: `/v3/projects/c5b7d6ba7cac4ef7b22269246343b2eb/users/2e2bdb0ed1b94b6e97a0bf4b061d5f19/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:54.400655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be58df-34d3-46ef-bc14-03fb4f78ced0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5b7d6ba7cac4ef7b22269246343b2eb, user_id=2e2bdb0ed1b94b6e97a0bf4b061d5f19, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:54.402056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be58df-34d3-46ef-bc14-03fb4f78ced0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:54.463775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 572/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:14:54 2022] PUT /identity/v3/projects/c5b7d6ba7cac4ef7b22269246343b2eb/users/2e2bdb0ed1b94b6e97a0bf4b061d5f19/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:14:56.309910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b61a7a-2fa3-416b-9d8c-2cb249a05ee9 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:56.310417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b61a7a-2fa3-416b-9d8c-2cb249a05ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:56.310526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b61a7a-2fa3-416b-9d8c-2cb249a05ee9 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:56.311784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 582/1154] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:56.317284 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223126e-4a87-4370-811d-74b477fc9ee9 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:56.317689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223126e-4a87-4370-811d-74b477fc9ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:56.317857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223126e-4a87-4370-811d-74b477fc9ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:56.336369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2223126e-4a87-4370-811d-74b477fc9ee9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:56.337544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2223126e-4a87-4370-811d-74b477fc9ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:56.340258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:56.401432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 573/1155] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:56.666693 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b61a7a-2fa3-416b-9d8c-2cb249a05ee9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:56.695310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:56.766287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b61a7a-2fa3-416b-9d8c-2cb249a05ee9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:56.798382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad631e2-eb82-44a6-85b8-588a9c3bc28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:56.798991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad631e2-eb82-44a6-85b8-588a9c3bc28d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:56.799294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad631e2-eb82-44a6-85b8-588a9c3bc28d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:56.799565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad631e2-eb82-44a6-85b8-588a9c3bc28d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:56.809688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad631e2-eb82-44a6-85b8-588a9c3bc28d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7ad631e2-eb82-44a6-85b8-588a9c3bc28d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:14:56.815033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:14:56.816155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:14:56.817032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 583/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:14:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:14:56.821985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223126e-4a87-4370-811d-74b477fc9ee9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:56.919115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223126e-4a87-4370-811d-74b477fc9ee9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:56.952349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565af2f-6fee-42ec-bd7a-a5d5ac237d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:56.952952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565af2f-6fee-42ec-bd7a-a5d5ac237d16 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:56.953229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565af2f-6fee-42ec-bd7a-a5d5ac237d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:56.953495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565af2f-6fee-42ec-bd7a-a5d5ac237d16 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:56.954165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565af2f-6fee-42ec-bd7a-a5d5ac237d16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:56.954464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565af2f-6fee-42ec-bd7a-a5d5ac237d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:56.955820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565af2f-6fee-42ec-bd7a-a5d5ac237d16 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:56.963527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 574/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:14:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:56.969993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad631e2-eb82-44a6-85b8-588a9c3bc28d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:57.054482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:57.065760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad631e2-eb82-44a6-85b8-588a9c3bc28d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:57.098206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e8816-cfaa-4b93-849c-4bd306fa0c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:57.098820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e8816-cfaa-4b93-849c-4bd306fa0c8f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:57.099097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e8816-cfaa-4b93-849c-4bd306fa0c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:57.099435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e8816-cfaa-4b93-849c-4bd306fa0c8f None admin] PATH_INFO: `/v3/users/2e2bdb0ed1b94b6e97a0bf4b061d5f19` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:57.100551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e8816-cfaa-4b93-849c-4bd306fa0c8f None admin] RBAC: Authorizing `identity:get_user(user_id=2e2bdb0ed1b94b6e97a0bf4b061d5f19)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:57.101952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e8816-cfaa-4b93-849c-4bd306fa0c8f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:57.103507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 584/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:14:56 2022] GET /identity/v3/users/2e2bdb0ed1b94b6e97a0bf4b061d5f19 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:57.109293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565af2f-6fee-42ec-bd7a-a5d5ac237d16 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:57.112716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:57.206369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565af2f-6fee-42ec-bd7a-a5d5ac237d16 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:57.239003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88482cb7-7834-46cc-95dc-1b466ec8126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:57.239584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88482cb7-7834-46cc-95dc-1b466ec8126b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:57.239853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88482cb7-7834-46cc-95dc-1b466ec8126b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:57.240150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88482cb7-7834-46cc-95dc-1b466ec8126b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:57.303799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88482cb7-7834-46cc-95dc-1b466ec8126b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:57.305246 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88482cb7-7834-46cc-95dc-1b466ec8126b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:57.306921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:57.400596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 575/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:14:57.406471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e8816-cfaa-4b93-849c-4bd306fa0c8f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:57.502282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e8816-cfaa-4b93-849c-4bd306fa0c8f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:57.534657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef575b-e851-4c9b-82fa-e1092f94b969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:57.535260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef575b-e851-4c9b-82fa-e1092f94b969 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:57.535533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef575b-e851-4c9b-82fa-e1092f94b969 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:57.535801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef575b-e851-4c9b-82fa-e1092f94b969 None admin] PATH_INFO: `/v3/projects/c5b7d6ba7cac4ef7b22269246343b2eb` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:57.536908 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef575b-e851-4c9b-82fa-e1092f94b969 None admin] RBAC: Authorizing `identity:get_project(project_id=c5b7d6ba7cac4ef7b22269246343b2eb)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:57.538314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef575b-e851-4c9b-82fa-e1092f94b969 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:57.539901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 585/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:14:57 2022] GET /identity/v3/projects/c5b7d6ba7cac4ef7b22269246343b2eb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:57.545826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88482cb7-7834-46cc-95dc-1b466ec8126b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:57.639554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88482cb7-7834-46cc-95dc-1b466ec8126b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:14:57.641052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:57.672941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70932b7-cd1d-4957-be1e-13b191e3af26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:14:57.673532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70932b7-cd1d-4957-be1e-13b191e3af26 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:57.673811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70932b7-cd1d-4957-be1e-13b191e3af26 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:57.674083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70932b7-cd1d-4957-be1e-13b191e3af26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:57.674868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70932b7-cd1d-4957-be1e-13b191e3af26 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=c5b7d6ba7cac4ef7b22269246343b2eb, user.id=2e2bdb0ed1b94b6e97a0bf4b061d5f19) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:14:57.675231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70932b7-cd1d-4957-be1e-13b191e3af26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:14:57.677047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70932b7-cd1d-4957-be1e-13b191e3af26 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:14:57.682992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 576/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:14:57 2022] GET /identity/v3/role_assignments?user.id=2e2bdb0ed1b94b6e97a0bf4b061d5f19&scope.project.id=c5b7d6ba7cac4ef7b22269246343b2eb&role.id=04d1bc62091440e189989e4b973a6627 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:14:59.560968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30e553-0518-40cb-b9af-206c3144d452 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:59.561527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30e553-0518-40cb-b9af-206c3144d452 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:59.561527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30e553-0518-40cb-b9af-206c3144d452 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:59.562834 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 586/1162] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:14:59.568414 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc05694-4eec-430b-8049-0bc91f16e097 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:14:59.568831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc05694-4eec-430b-8049-0bc91f16e097 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:14:59.568962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc05694-4eec-430b-8049-0bc91f16e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:14:59.587247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7dc05694-4eec-430b-8049-0bc91f16e097 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:14:59.588436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7dc05694-4eec-430b-8049-0bc91f16e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:14:59.652231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 577/1163] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:14:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:14:59.914542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30e553-0518-40cb-b9af-206c3144d452 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:14:59.941632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:00.014919 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30e553-0518-40cb-b9af-206c3144d452 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:00.047542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54be7-c785-46a4-b418-6016faf960e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:00.048687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54be7-c785-46a4-b418-6016faf960e8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:00.048960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54be7-c785-46a4-b418-6016faf960e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:00.049228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54be7-c785-46a4-b418-6016faf960e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:00.113370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a54be7-c785-46a4-b418-6016faf960e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:00.114739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a54be7-c785-46a4-b418-6016faf960e8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:00.137148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:00.208606 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 587/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:14:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:15:00.214464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc05694-4eec-430b-8049-0bc91f16e097 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:00.304070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:00.309806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc05694-4eec-430b-8049-0bc91f16e097 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:00.341891 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788d4c5-3869-4259-b7f4-dc71eb03e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:00.342497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d4c5-3869-4259-b7f4-dc71eb03e3be None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:00.342772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d4c5-3869-4259-b7f4-dc71eb03e3be None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:00.343042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d4c5-3869-4259-b7f4-dc71eb03e3be None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:00.350021 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788d4c5-3869-4259-b7f4-dc71eb03e3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:00.351665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788d4c5-3869-4259-b7f4-dc71eb03e3be None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e788d4c5-3869-4259-b7f4-dc71eb03e3be None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:15:00.363255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:15:00.364514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:15:00.365643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 578/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Fri Sep 2 09:15:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:15:00.370273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54be7-c785-46a4-b418-6016faf960e8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:00.465236 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54be7-c785-46a4-b418-6016faf960e8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:00.487735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:00.497735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef1256-5272-44be-9998-a541cbc86351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:00.498365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1256-5272-44be-9998-a541cbc86351 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:00.498638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1256-5272-44be-9998-a541cbc86351 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:00.498905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1256-5272-44be-9998-a541cbc86351 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:00.499525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef1256-5272-44be-9998-a541cbc86351 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:15:00.499819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef1256-5272-44be-9998-a541cbc86351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:00.501479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef1256-5272-44be-9998-a541cbc86351 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:00.508599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 588/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Fri Sep 2 09:15:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:02.367384 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb1072-8c7b-43aa-b58a-cb73295df99c None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:02.367983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb1072-8c7b-43aa-b58a-cb73295df99c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:02.367983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb1072-8c7b-43aa-b58a-cb73295df99c None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:02.369337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 579/1167] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:15:02.374409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c708a-eebb-4f77-a8da-a94bd6d44019 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:02.374787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c708a-eebb-4f77-a8da-a94bd6d44019 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:02.374947 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c708a-eebb-4f77-a8da-a94bd6d44019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:02.393642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d43c708a-eebb-4f77-a8da-a94bd6d44019 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:15:02.394799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d43c708a-eebb-4f77-a8da-a94bd6d44019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:15:02.458478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 589/1168] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:15:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:15:02.722887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb1072-8c7b-43aa-b58a-cb73295df99c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:02.827516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb1072-8c7b-43aa-b58a-cb73295df99c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:02.862183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc53d6-2d07-4727-a085-94a7979278f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:02.862786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc53d6-2d07-4727-a085-94a7979278f0 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:02.863061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc53d6-2d07-4727-a085-94a7979278f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:02.863333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc53d6-2d07-4727-a085-94a7979278f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:02.864019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc53d6-2d07-4727-a085-94a7979278f0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:02.865403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc53d6-2d07-4727-a085-94a7979278f0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:02.940425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 580/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Fri Sep 2 09:15:02 2022] POST /identity/v3/domains => generated 267 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:15:04.822678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0a0d-a50b-4dfc-bb7a-404b51c0cb44 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:04.823205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0a0d-a50b-4dfc-bb7a-404b51c0cb44 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:04.823205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0a0d-a50b-4dfc-bb7a-404b51c0cb44 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:04.824596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 590/1170] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:15:04.830334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e15e8d-a7d8-405e-a9a6-412708fbbd96 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:04.830778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e15e8d-a7d8-405e-a9a6-412708fbbd96 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:04.830873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e15e8d-a7d8-405e-a9a6-412708fbbd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:04.849219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-63e15e8d-a7d8-405e-a9a6-412708fbbd96 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:15:04.850396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-63e15e8d-a7d8-405e-a9a6-412708fbbd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:15:04.861357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:04.915973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 581/1171] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:15:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:15:05.179849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa0a0d-a50b-4dfc-bb7a-404b51c0cb44 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:05.276507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa0a0d-a50b-4dfc-bb7a-404b51c0cb44 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:05.293050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:05.309800 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727d2cd-e09f-4c6b-8309-94147ba566c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:05.310419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d2cd-e09f-4c6b-8309-94147ba566c8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:05.310697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d2cd-e09f-4c6b-8309-94147ba566c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:05.310968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d2cd-e09f-4c6b-8309-94147ba566c8 None admin] PATH_INFO: `/v3/domains/43a8c3661076487f9905ece5fa77dc36` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:05.321609 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d2cd-e09f-4c6b-8309-94147ba566c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=43a8c3661076487f9905ece5fa77dc36)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:05.323089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d2cd-e09f-4c6b-8309-94147ba566c8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:05.324752 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 591/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Fri Sep 2 09:15:05 2022] GET /identity/v3/domains/43a8c3661076487f9905ece5fa77dc36 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:05.330415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e15e8d-a7d8-405e-a9a6-412708fbbd96 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:05.427811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e15e8d-a7d8-405e-a9a6-412708fbbd96 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:05.459606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4041528-1da1-4945-b4ec-4a3567252b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:05.460171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041528-1da1-4945-b4ec-4a3567252b8c None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:05.460446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041528-1da1-4945-b4ec-4a3567252b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:05.460717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041528-1da1-4945-b4ec-4a3567252b8c None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:05.461365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4041528-1da1-4945-b4ec-4a3567252b8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:05.462779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4041528-1da1-4945-b4ec-4a3567252b8c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:05.528564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:05.535488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 582/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:15:05 2022] POST /identity/v3/projects => generated 361 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:15:07.441741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb420-8b69-4a5b-a07e-02c1ff9de5ea None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:07.442263 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb420-8b69-4a5b-a07e-02c1ff9de5ea None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:07.442263 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb420-8b69-4a5b-a07e-02c1ff9de5ea None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:07.443629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 592/1174] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:15:07.448686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bf1a0-9fbf-466e-89ab-a445bab86fb6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:07.449049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bf1a0-9fbf-466e-89ab-a445bab86fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:07.449239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bf1a0-9fbf-466e-89ab-a445bab86fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:07.467396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e13bf1a0-9fbf-466e-89ab-a445bab86fb6 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:15:07.468602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e13bf1a0-9fbf-466e-89ab-a445bab86fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:15:07.533206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 583/1175] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:15:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:15:07.801525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb420-8b69-4a5b-a07e-02c1ff9de5ea None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:07.900999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb420-8b69-4a5b-a07e-02c1ff9de5ea None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:07.933054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb8659-a0be-44d7-9d4d-af90616633fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:07.933670 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8659-a0be-44d7-9d4d-af90616633fb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:07.933945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8659-a0be-44d7-9d4d-af90616633fb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:07.934214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8659-a0be-44d7-9d4d-af90616633fb None admin] PATH_INFO: `/v3/domains/43a8c3661076487f9905ece5fa77dc36` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:07.935308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb8659-a0be-44d7-9d4d-af90616633fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=43a8c3661076487f9905ece5fa77dc36)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:07.936759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb8659-a0be-44d7-9d4d-af90616633fb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:07.938307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 593/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Fri Sep 2 09:15:07 2022] GET /identity/v3/domains/43a8c3661076487f9905ece5fa77dc36 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:07.944606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bf1a0-9fbf-466e-89ab-a445bab86fb6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:08.037078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bf1a0-9fbf-466e-89ab-a445bab86fb6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:08.062568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:08.070512 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc0c70-000c-4d18-894f-7ed55729dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:08.071104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0c70-000c-4d18-894f-7ed55729dea7 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:08.071377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0c70-000c-4d18-894f-7ed55729dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:08.071642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0c70-000c-4d18-894f-7ed55729dea7 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:08.072301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc0c70-000c-4d18-894f-7ed55729dea7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:08.073713 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc0c70-000c-4d18-894f-7ed55729dea7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:08.191160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 584/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:15:07 2022] POST /identity/v3/users => generated 311 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:15:10.119783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4f393-3137-4499-b5bb-c65ae85c3a3c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:10.120341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4f393-3137-4499-b5bb-c65ae85c3a3c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:10.120341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4f393-3137-4499-b5bb-c65ae85c3a3c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:10.121596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 594/1178] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:15:10.127013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4d764-2dee-42e9-acc3-5b5c5e6b00c6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:10.127941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4d764-2dee-42e9-acc3-5b5c5e6b00c6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:10.128248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4d764-2dee-42e9-acc3-5b5c5e6b00c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:10.146157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7eb4d764-2dee-42e9-acc3-5b5c5e6b00c6 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:15:10.147324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7eb4d764-2dee-42e9-acc3-5b5c5e6b00c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:15:10.210659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 585/1179] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:15:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:15:10.474106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4f393-3137-4499-b5bb-c65ae85c3a3c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:10.520067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:10.572177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4f393-3137-4499-b5bb-c65ae85c3a3c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:10.604252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d21af-c0e6-4eb1-a691-a7b49e9e6c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:10.604863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d21af-c0e6-4eb1-a691-a7b49e9e6c6a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:10.605134 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d21af-c0e6-4eb1-a691-a7b49e9e6c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:10.605401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d21af-c0e6-4eb1-a691-a7b49e9e6c6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:10.616003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d21af-c0e6-4eb1-a691-a7b49e9e6c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6a2d21af-c0e6-4eb1-a691-a7b49e9e6c6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:15:10.620676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:15:10.621771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:15:10.622771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 595/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:15:10.628069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4d764-2dee-42e9-acc3-5b5c5e6b00c6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:10.721537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4d764-2dee-42e9-acc3-5b5c5e6b00c6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:10.734662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:10.754139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195046d-e393-4dd2-b20a-ea80929af1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:10.754725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195046d-e393-4dd2-b20a-ea80929af1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:10.754997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195046d-e393-4dd2-b20a-ea80929af1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:10.755269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195046d-e393-4dd2-b20a-ea80929af1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:10.755938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195046d-e393-4dd2-b20a-ea80929af1b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:15:10.756236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195046d-e393-4dd2-b20a-ea80929af1b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:10.757587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195046d-e393-4dd2-b20a-ea80929af1b2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:10.765525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 586/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:15:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:10.771218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d21af-c0e6-4eb1-a691-a7b49e9e6c6a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:10.868147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d21af-c0e6-4eb1-a691-a7b49e9e6c6a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:10.874614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:10.900535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110b042-6af4-4a17-8784-facad344b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:10.901143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110b042-6af4-4a17-8784-facad344b8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:10.901416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110b042-6af4-4a17-8784-facad344b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:10.901684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110b042-6af4-4a17-8784-facad344b8b4 None admin] PATH_INFO: `/v3/users/331f62755ef44aec9b57dc119c41d685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:10.915122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110b042-6af4-4a17-8784-facad344b8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=331f62755ef44aec9b57dc119c41d685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:10.916572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110b042-6af4-4a17-8784-facad344b8b4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:10.918138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 596/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:15:10 2022] GET /identity/v3/users/331f62755ef44aec9b57dc119c41d685 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:10.924157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195046d-e393-4dd2-b20a-ea80929af1b2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:11.020492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195046d-e393-4dd2-b20a-ea80929af1b2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:11.052675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04dcfc-2253-4cda-bf5d-4295b622da5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:11.053284 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04dcfc-2253-4cda-bf5d-4295b622da5d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:11.053556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04dcfc-2253-4cda-bf5d-4295b622da5d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:11.053821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04dcfc-2253-4cda-bf5d-4295b622da5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:11.097326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:11.118436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04dcfc-2253-4cda-bf5d-4295b622da5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:11.119862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04dcfc-2253-4cda-bf5d-4295b622da5d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:11.216705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 587/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:15:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:15:11.223877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110b042-6af4-4a17-8784-facad344b8b4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:11.317690 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110b042-6af4-4a17-8784-facad344b8b4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:11.349766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f147a9-045e-451b-a270-2fd4419f7df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:11.350376 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f147a9-045e-451b-a270-2fd4419f7df6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:11.350646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f147a9-045e-451b-a270-2fd4419f7df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:11.350914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f147a9-045e-451b-a270-2fd4419f7df6 None admin] PATH_INFO: `/v3/projects/7ebe35610cc64ffe8d52c40c726bc9b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:11.352020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f147a9-045e-451b-a270-2fd4419f7df6 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebe35610cc64ffe8d52c40c726bc9b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:11.353427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f147a9-045e-451b-a270-2fd4419f7df6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:11.355001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 597/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:15:11 2022] GET /identity/v3/projects/7ebe35610cc64ffe8d52c40c726bc9b6 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:11.360943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04dcfc-2253-4cda-bf5d-4295b622da5d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:11.433304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:11.455069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04dcfc-2253-4cda-bf5d-4295b622da5d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:11.487956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623bd9d-4edf-4ad9-8ab4-60bb7cb65b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:11.488538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623bd9d-4edf-4ad9-8ab4-60bb7cb65b9a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:11.488809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623bd9d-4edf-4ad9-8ab4-60bb7cb65b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:11.489074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623bd9d-4edf-4ad9-8ab4-60bb7cb65b9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:11.489774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623bd9d-4edf-4ad9-8ab4-60bb7cb65b9a None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=7ebe35610cc64ffe8d52c40c726bc9b6, user.id=331f62755ef44aec9b57dc119c41d685) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:15:11.490069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623bd9d-4edf-4ad9-8ab4-60bb7cb65b9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:11.491476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623bd9d-4edf-4ad9-8ab4-60bb7cb65b9a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:11.496614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 588/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:15:11 2022] GET /identity/v3/role_assignments?user.id=331f62755ef44aec9b57dc119c41d685&scope.project.id=7ebe35610cc64ffe8d52c40c726bc9b6&role.id=04d1bc62091440e189989e4b973a6627 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:15:13.372031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfad9d8-db9f-43bf-af99-7964f504f38f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:13.372593 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfad9d8-db9f-43bf-af99-7964f504f38f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:13.372593 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfad9d8-db9f-43bf-af99-7964f504f38f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:13.373920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 598/1186] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:15:13.379359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35debbb3-dc33-43aa-9e2d-88cd5f8eede3 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:13.379803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35debbb3-dc33-43aa-9e2d-88cd5f8eede3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:13.379928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35debbb3-dc33-43aa-9e2d-88cd5f8eede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:13.397916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-35debbb3-dc33-43aa-9e2d-88cd5f8eede3 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:15:13.399101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-35debbb3-dc33-43aa-9e2d-88cd5f8eede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:15:13.462385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 589/1187] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:15:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:15:13.731558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfad9d8-db9f-43bf-af99-7964f504f38f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:13.762450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:13.831409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfad9d8-db9f-43bf-af99-7964f504f38f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:13.864008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6374e86-1474-4dc1-b43d-f97f32d5cd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:13.864618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6374e86-1474-4dc1-b43d-f97f32d5cd45 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:13.864889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6374e86-1474-4dc1-b43d-f97f32d5cd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:13.865156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6374e86-1474-4dc1-b43d-f97f32d5cd45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:13.874780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6374e86-1474-4dc1-b43d-f97f32d5cd45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e6374e86-1474-4dc1-b43d-f97f32d5cd45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:15:13.880362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:15:13.881530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:15:13.882598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 599/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:15:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:15:13.887526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35debbb3-dc33-43aa-9e2d-88cd5f8eede3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:13.953469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:13.982302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35debbb3-dc33-43aa-9e2d-88cd5f8eede3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:14.015517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d780-cd1c-4cc7-ad1c-564aa806a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:14.016133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d780-cd1c-4cc7-ad1c-564aa806a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:14.016410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d780-cd1c-4cc7-ad1c-564aa806a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:14.016676 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d780-cd1c-4cc7-ad1c-564aa806a2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:14.017325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019d780-cd1c-4cc7-ad1c-564aa806a2d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:15:14.017623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019d780-cd1c-4cc7-ad1c-564aa806a2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:14.019008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019d780-cd1c-4cc7-ad1c-564aa806a2d3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:14.026686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 590/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:15:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:14.032519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6374e86-1474-4dc1-b43d-f97f32d5cd45 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:14.119924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:14.129108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6374e86-1474-4dc1-b43d-f97f32d5cd45 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:14.161536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a72cc4-3406-41e5-bf8a-7820003f6618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:14.162145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a72cc4-3406-41e5-bf8a-7820003f6618 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:14.162422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a72cc4-3406-41e5-bf8a-7820003f6618 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:14.162695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a72cc4-3406-41e5-bf8a-7820003f6618 None admin] PATH_INFO: `/v3/users/331f62755ef44aec9b57dc119c41d685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:14.163796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a72cc4-3406-41e5-bf8a-7820003f6618 None admin] RBAC: Authorizing `identity:get_user(user_id=331f62755ef44aec9b57dc119c41d685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:14.165236 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a72cc4-3406-41e5-bf8a-7820003f6618 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:14.166787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 600/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:15:14 2022] GET /identity/v3/users/331f62755ef44aec9b57dc119c41d685 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:14.172546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d780-cd1c-4cc7-ad1c-564aa806a2d3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:14.269575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d780-cd1c-4cc7-ad1c-564aa806a2d3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:14.297304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:14.302696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20af20c-7c93-4a9d-8ee9-5198b3ccc2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:14.303319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20af20c-7c93-4a9d-8ee9-5198b3ccc2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:14.303609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20af20c-7c93-4a9d-8ee9-5198b3ccc2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:14.303899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20af20c-7c93-4a9d-8ee9-5198b3ccc2e9 None admin] PATH_INFO: `/v3/projects/7ebe35610cc64ffe8d52c40c726bc9b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:14.308599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20af20c-7c93-4a9d-8ee9-5198b3ccc2e9 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebe35610cc64ffe8d52c40c726bc9b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:14.308599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20af20c-7c93-4a9d-8ee9-5198b3ccc2e9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:14.308599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 591/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:15:14 2022] GET /identity/v3/projects/7ebe35610cc64ffe8d52c40c726bc9b6 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:14.313741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a72cc4-3406-41e5-bf8a-7820003f6618 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:14.409540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a72cc4-3406-41e5-bf8a-7820003f6618 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:14.442080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52ec3a-b9c3-41b6-80a0-6c2df5193ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:14.442715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52ec3a-b9c3-41b6-80a0-6c2df5193ac7 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:14.442990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52ec3a-b9c3-41b6-80a0-6c2df5193ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:14.443263 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52ec3a-b9c3-41b6-80a0-6c2df5193ac7 None admin] PATH_INFO: `/v3/projects/7ebe35610cc64ffe8d52c40c726bc9b6/users/331f62755ef44aec9b57dc119c41d685/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:14.445152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52ec3a-b9c3-41b6-80a0-6c2df5193ac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ebe35610cc64ffe8d52c40c726bc9b6, user_id=331f62755ef44aec9b57dc119c41d685, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:14.446550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52ec3a-b9c3-41b6-80a0-6c2df5193ac7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:14.493877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 601/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:15:14 2022] PUT /identity/v3/projects/7ebe35610cc64ffe8d52c40c726bc9b6/users/331f62755ef44aec9b57dc119c41d685/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:15:16.355359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7502-3ad8-4dd5-b42c-06f2c7475eaa None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:16.355929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7502-3ad8-4dd5-b42c-06f2c7475eaa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:16.355929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7502-3ad8-4dd5-b42c-06f2c7475eaa None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:16.357269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 592/1193] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:15:16.362350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99981ea-947c-401e-848a-08d431105325 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:16.362786 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99981ea-947c-401e-848a-08d431105325 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:16.362887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99981ea-947c-401e-848a-08d431105325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:16.380589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d99981ea-947c-401e-848a-08d431105325 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:15:16.381767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d99981ea-947c-401e-848a-08d431105325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:15:16.395598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:16.445533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 602/1194] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:15:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 09:15:16.712696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7502-3ad8-4dd5-b42c-06f2c7475eaa None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:16.810188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7502-3ad8-4dd5-b42c-06f2c7475eaa None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:16.842820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2c62-e48e-4818-9177-27c2c7184b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:16.843438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2c62-e48e-4818-9177-27c2c7184b7c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:16.843707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2c62-e48e-4818-9177-27c2c7184b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:16.843998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2c62-e48e-4818-9177-27c2c7184b7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:16.854188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d2c62-e48e-4818-9177-27c2c7184b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-889d2c62-e48e-4818-9177-27c2c7184b7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:15:16.858930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:15:16.860039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:15:16.860986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 593/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:15:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:15:16.866479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99981ea-947c-401e-848a-08d431105325 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:16.961550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99981ea-947c-401e-848a-08d431105325 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:16.993532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ee6f2-060d-4c26-94fe-2718d5207fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:16.994067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ee6f2-060d-4c26-94fe-2718d5207fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:16.994339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ee6f2-060d-4c26-94fe-2718d5207fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:16.994604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ee6f2-060d-4c26-94fe-2718d5207fd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:16.995248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ee6f2-060d-4c26-94fe-2718d5207fd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:15:16.995546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ee6f2-060d-4c26-94fe-2718d5207fd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:16.996917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ee6f2-060d-4c26-94fe-2718d5207fd8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:17.005333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 603/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:15:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:17.011118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2c62-e48e-4818-9177-27c2c7184b7c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:17.068280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:17.106121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2c62-e48e-4818-9177-27c2c7184b7c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:17.138606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9a260-2cf4-4f54-bb61-6713b27cfda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:17.139213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9a260-2cf4-4f54-bb61-6713b27cfda8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:17.139489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9a260-2cf4-4f54-bb61-6713b27cfda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:17.139758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9a260-2cf4-4f54-bb61-6713b27cfda8 None admin] PATH_INFO: `/v3/users/331f62755ef44aec9b57dc119c41d685` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:17.140882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9a260-2cf4-4f54-bb61-6713b27cfda8 None admin] RBAC: Authorizing `identity:get_user(user_id=331f62755ef44aec9b57dc119c41d685)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:17.142306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9a260-2cf4-4f54-bb61-6713b27cfda8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:17.143875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 594/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Fri Sep 2 09:15:17 2022] GET /identity/v3/users/331f62755ef44aec9b57dc119c41d685 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:17.149691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ee6f2-060d-4c26-94fe-2718d5207fd8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:17.164640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:17.248026 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ee6f2-060d-4c26-94fe-2718d5207fd8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:17.280436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675650d-a0c0-4ea4-801b-f62a5918ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:17.281029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675650d-a0c0-4ea4-801b-f62a5918ebc3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:17.281305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675650d-a0c0-4ea4-801b-f62a5918ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:17.281575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675650d-a0c0-4ea4-801b-f62a5918ebc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:17.345104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675650d-a0c0-4ea4-801b-f62a5918ebc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:17.346546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675650d-a0c0-4ea4-801b-f62a5918ebc3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:17.359804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:17.440935 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 604/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:15:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:15:17.446868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9a260-2cf4-4f54-bb61-6713b27cfda8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:17.543467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9a260-2cf4-4f54-bb61-6713b27cfda8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:17.572677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:17.580180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212569c-3778-46be-84d0-7468265f8ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:17.583864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212569c-3778-46be-84d0-7468265f8ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:17.583864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212569c-3778-46be-84d0-7468265f8ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:17.583864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212569c-3778-46be-84d0-7468265f8ae2 None admin] PATH_INFO: `/v3/projects/7ebe35610cc64ffe8d52c40c726bc9b6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:17.583864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212569c-3778-46be-84d0-7468265f8ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=7ebe35610cc64ffe8d52c40c726bc9b6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:17.584371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212569c-3778-46be-84d0-7468265f8ae2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:17.585981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 595/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Fri Sep 2 09:15:17 2022] GET /identity/v3/projects/7ebe35610cc64ffe8d52c40c726bc9b6 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:17.592243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675650d-a0c0-4ea4-801b-f62a5918ebc3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:15:17.687499 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675650d-a0c0-4ea4-801b-f62a5918ebc3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:15:17.700588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:17.720758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372a24c-3dfc-43d5-9ca9-727c9d2633ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:15:17.721344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372a24c-3dfc-43d5-9ca9-727c9d2633ca None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:15:17.721615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372a24c-3dfc-43d5-9ca9-727c9d2633ca None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:15:17.721915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372a24c-3dfc-43d5-9ca9-727c9d2633ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:15:17.723202 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372a24c-3dfc-43d5-9ca9-727c9d2633ca None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=7ebe35610cc64ffe8d52c40c726bc9b6, user.id=331f62755ef44aec9b57dc119c41d685) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:15:17.723504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372a24c-3dfc-43d5-9ca9-727c9d2633ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:15:17.724949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372a24c-3dfc-43d5-9ca9-727c9d2633ca None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:15:17.731124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 605/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:15:17 2022] GET /identity/v3/role_assignments?user.id=331f62755ef44aec9b57dc119c41d685&scope.project.id=7ebe35610cc64ffe8d52c40c726bc9b6&role.id=04d1bc62091440e189989e4b973a6627 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:15:27.608858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:27.729176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=12 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:28.187965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18052-21ab-4117-a859-7aefd70f1c33 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:28.188541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18052-21ab-4117-a859-7aefd70f1c33 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:28.188541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18052-21ab-4117-a859-7aefd70f1c33 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:28.189826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 596/1201] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:16:28.195000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b2cf7-880a-432e-982c-231b6b5a8c1a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:28.195447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b2cf7-880a-432e-982c-231b6b5a8c1a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:28.195547 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b2cf7-880a-432e-982c-231b6b5a8c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:28.213985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-094b2cf7-880a-432e-982c-231b6b5a8c1a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:16:28.215322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-094b2cf7-880a-432e-982c-231b6b5a8c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:16:28.281718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 606/1202] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:16:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:16:28.556264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d18052-21ab-4117-a859-7aefd70f1c33 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:28.657692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d18052-21ab-4117-a859-7aefd70f1c33 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:28.690225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b74d6d-7595-48b7-8f6b-2606507d7a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:28.690841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74d6d-7595-48b7-8f6b-2606507d7a80 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:28.691116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74d6d-7595-48b7-8f6b-2606507d7a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:28.691385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74d6d-7595-48b7-8f6b-2606507d7a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:28.701558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b74d6d-7595-48b7-8f6b-2606507d7a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:28.702997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b74d6d-7595-48b7-8f6b-2606507d7a80 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-25b74d6d-7595-48b7-8f6b-2606507d7a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:28.717598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:28.718641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:28.719764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:28.719764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:28.719764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:28.719764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 597/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:28.724848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b2cf7-880a-432e-982c-231b6b5a8c1a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:28.821263 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b2cf7-880a-432e-982c-231b6b5a8c1a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:28.850043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:28.855821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefee2b-dcbe-4a0c-9d98-1d5eefcdd8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:28.866823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefee2b-dcbe-4a0c-9d98-1d5eefcdd8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:28.866823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefee2b-dcbe-4a0c-9d98-1d5eefcdd8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:28.866823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefee2b-dcbe-4a0c-9d98-1d5eefcdd8a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:28.866823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefee2b-dcbe-4a0c-9d98-1d5eefcdd8a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:28.866823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefee2b-dcbe-4a0c-9d98-1d5eefcdd8a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:28.866823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefee2b-dcbe-4a0c-9d98-1d5eefcdd8a5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:28.870070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 607/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:28.876461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b74d6d-7595-48b7-8f6b-2606507d7a80 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:28.929589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:28.975952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b74d6d-7595-48b7-8f6b-2606507d7a80 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:29.008329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26193ec4-2932-44e4-b931-cbccf399e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:29.008976 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26193ec4-2932-44e4-b931-cbccf399e2a3 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:29.009256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26193ec4-2932-44e4-b931-cbccf399e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:29.009530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26193ec4-2932-44e4-b931-cbccf399e2a3 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:29.010179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26193ec4-2932-44e4-b931-cbccf399e2a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:29.011860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26193ec4-2932-44e4-b931-cbccf399e2a3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:29.084075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 598/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Fri Sep 2 09:16:28 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:16:31.012546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db07b8-2d7e-4b29-b15b-93ccb9bf1f99 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:31.013104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db07b8-2d7e-4b29-b15b-93ccb9bf1f99 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:31.013104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db07b8-2d7e-4b29-b15b-93ccb9bf1f99 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:31.014413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 608/1206] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:16:31.020085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbff96-578f-408a-ae27-4eb47f9124cd None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:31.020585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbff96-578f-408a-ae27-4eb47f9124cd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:31.020723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbff96-578f-408a-ae27-4eb47f9124cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:31.038596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8acbff96-578f-408a-ae27-4eb47f9124cd None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:16:31.039765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8acbff96-578f-408a-ae27-4eb47f9124cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:16:31.106444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 599/1207] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:16:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:16:31.374577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db07b8-2d7e-4b29-b15b-93ccb9bf1f99 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:31.474475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db07b8-2d7e-4b29-b15b-93ccb9bf1f99 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:31.507289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43e8e8-f227-40e5-ba9a-4e3ef3fc7b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:31.507963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43e8e8-f227-40e5-ba9a-4e3ef3fc7b69 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:31.508248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43e8e8-f227-40e5-ba9a-4e3ef3fc7b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:31.508582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43e8e8-f227-40e5-ba9a-4e3ef3fc7b69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:31.519656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43e8e8-f227-40e5-ba9a-4e3ef3fc7b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ed43e8e8-f227-40e5-ba9a-4e3ef3fc7b69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:16:31.525147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:31.526234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:31.527156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 609/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:31.531618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbff96-578f-408a-ae27-4eb47f9124cd None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:31.570829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:31.628604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbff96-578f-408a-ae27-4eb47f9124cd None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:31.661100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e8792-52ae-42e8-88c9-f11388d8aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:31.665529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e8792-52ae-42e8-88c9-f11388d8aba6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:31.665529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e8792-52ae-42e8-88c9-f11388d8aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:31.665529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e8792-52ae-42e8-88c9-f11388d8aba6 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:31.665529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e8792-52ae-42e8-88c9-f11388d8aba6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:31.665529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e8792-52ae-42e8-88c9-f11388d8aba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:31.665529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e8792-52ae-42e8-88c9-f11388d8aba6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:31.672179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 600/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:31.678523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43e8e8-f227-40e5-ba9a-4e3ef3fc7b69 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:31.727053 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:31.775822 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43e8e8-f227-40e5-ba9a-4e3ef3fc7b69 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:31.809800 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc9495-a6e7-4a40-8f9b-79781f92c47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:31.810420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc9495-a6e7-4a40-8f9b-79781f92c47c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:31.810696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc9495-a6e7-4a40-8f9b-79781f92c47c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:31.810967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc9495-a6e7-4a40-8f9b-79781f92c47c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:31.821785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc9495-a6e7-4a40-8f9b-79781f92c47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:31.826881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc9495-a6e7-4a40-8f9b-79781f92c47c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c2fc9495-a6e7-4a40-8f9b-79781f92c47c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:31.837351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:31.838579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:31.839677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:31.839677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:31.839677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:31.839677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 610/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:31.844383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e8792-52ae-42e8-88c9-f11388d8aba6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:31.940413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:31.943072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e8792-52ae-42e8-88c9-f11388d8aba6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:31.975253 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87cffb-02d3-425a-a0b9-a1e8f39b6737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:31.975844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87cffb-02d3-425a-a0b9-a1e8f39b6737 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:31.976143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87cffb-02d3-425a-a0b9-a1e8f39b6737 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:31.976411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87cffb-02d3-425a-a0b9-a1e8f39b6737 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:31.977040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87cffb-02d3-425a-a0b9-a1e8f39b6737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:31.977335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87cffb-02d3-425a-a0b9-a1e8f39b6737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:31.978690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87cffb-02d3-425a-a0b9-a1e8f39b6737 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:31.990438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 601/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:31.996544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc9495-a6e7-4a40-8f9b-79781f92c47c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:32.096528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc9495-a6e7-4a40-8f9b-79781f92c47c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:32.098030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:32.128755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb94e-286a-4d12-8b87-54c728db7f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:32.129434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb94e-286a-4d12-8b87-54c728db7f5d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:32.129704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb94e-286a-4d12-8b87-54c728db7f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:32.129970 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb94e-286a-4d12-8b87-54c728db7f5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:32.137665 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebb94e-286a-4d12-8b87-54c728db7f5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:32.140535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebb94e-286a-4d12-8b87-54c728db7f5d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6cebb94e-286a-4d12-8b87-54c728db7f5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:16:32.150610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:32.151730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:32.152994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 611/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:32.158714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87cffb-02d3-425a-a0b9-a1e8f39b6737 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:32.256235 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87cffb-02d3-425a-a0b9-a1e8f39b6737 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:32.291474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14ac7d-2bec-48ab-9c46-8d2c056c2487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:32.292118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14ac7d-2bec-48ab-9c46-8d2c056c2487 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:32.292423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14ac7d-2bec-48ab-9c46-8d2c056c2487 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:32.292665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14ac7d-2bec-48ab-9c46-8d2c056c2487 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:32.293393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14ac7d-2bec-48ab-9c46-8d2c056c2487 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:32.293691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14ac7d-2bec-48ab-9c46-8d2c056c2487 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:32.295112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14ac7d-2bec-48ab-9c46-8d2c056c2487 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:32.312333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 602/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Fri Sep 2 09:16:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:32.318268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb94e-286a-4d12-8b87-54c728db7f5d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:32.415577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb94e-286a-4d12-8b87-54c728db7f5d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:32.447842 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1932fe-5062-4a24-9728-4912871f4cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:32.448459 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1932fe-5062-4a24-9728-4912871f4cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:32.448729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1932fe-5062-4a24-9728-4912871f4cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:32.448990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1932fe-5062-4a24-9728-4912871f4cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:32.477935 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:32.514619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1932fe-5062-4a24-9728-4912871f4cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:32.516019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1932fe-5062-4a24-9728-4912871f4cd8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:32.609883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 612/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:16:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:16:32.615925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14ac7d-2bec-48ab-9c46-8d2c056c2487 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:32.635062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:32.712536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14ac7d-2bec-48ab-9c46-8d2c056c2487 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:32.744411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cd8ed-ff36-44dd-9d40-b4940a4034fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:32.745025 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cd8ed-ff36-44dd-9d40-b4940a4034fc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:32.745300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cd8ed-ff36-44dd-9d40-b4940a4034fc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:32.745568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cd8ed-ff36-44dd-9d40-b4940a4034fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:32.755714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cd8ed-ff36-44dd-9d40-b4940a4034fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:32.757176 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cd8ed-ff36-44dd-9d40-b4940a4034fc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b95cd8ed-ff36-44dd-9d40-b4940a4034fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:32.773685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:32.779097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:32.780224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:32.780224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:32.780224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:32.780224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 603/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:32.780666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1932fe-5062-4a24-9728-4912871f4cd8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:32.840308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:32.878112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1932fe-5062-4a24-9728-4912871f4cd8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:32.912059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d642652-9af7-454c-b5d8-15e086e16c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:32.912662 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d642652-9af7-454c-b5d8-15e086e16c40 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:32.912937 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d642652-9af7-454c-b5d8-15e086e16c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:32.913208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d642652-9af7-454c-b5d8-15e086e16c40 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:32.913839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d642652-9af7-454c-b5d8-15e086e16c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:32.914139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d642652-9af7-454c-b5d8-15e086e16c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:32.915489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d642652-9af7-454c-b5d8-15e086e16c40 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:32.928194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 613/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:16:32.933931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cd8ed-ff36-44dd-9d40-b4940a4034fc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:33.003135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:33.031990 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cd8ed-ff36-44dd-9d40-b4940a4034fc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:33.064220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979efaf5-1117-446e-b60e-fbb405a4e177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:33.064837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979efaf5-1117-446e-b60e-fbb405a4e177 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:33.065137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979efaf5-1117-446e-b60e-fbb405a4e177 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:33.065404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979efaf5-1117-446e-b60e-fbb405a4e177 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:33.071705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979efaf5-1117-446e-b60e-fbb405a4e177 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:33.073159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979efaf5-1117-446e-b60e-fbb405a4e177 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-979efaf5-1117-446e-b60e-fbb405a4e177 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:16:33.084705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:33.087808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:33.088927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:16:33.088927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:16:33.088927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:16:33.088927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:16:33.088927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:16:33.088927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:16:33.088927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:33.088927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:33.088927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 604/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:16:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:16:33.091634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d642652-9af7-454c-b5d8-15e086e16c40 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:33.190663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d642652-9af7-454c-b5d8-15e086e16c40 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:33.212099 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:33.223772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9540f-f818-4313-aa0e-a410c8c3a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:33.224401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9540f-f818-4313-aa0e-a410c8c3a4af None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:33.224681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9540f-f818-4313-aa0e-a410c8c3a4af None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:33.224952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9540f-f818-4313-aa0e-a410c8c3a4af None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:33.225633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9540f-f818-4313-aa0e-a410c8c3a4af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:33.225963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9540f-f818-4313-aa0e-a410c8c3a4af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:33.227414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9540f-f818-4313-aa0e-a410c8c3a4af None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:33.239613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 614/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:16:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:33.245844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979efaf5-1117-446e-b60e-fbb405a4e177 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:33.346303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979efaf5-1117-446e-b60e-fbb405a4e177 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:33.374134 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:33.379587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3edf2-2ec9-498c-904f-ed409f6c147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:33.380190 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3edf2-2ec9-498c-904f-ed409f6c147f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:33.380502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3edf2-2ec9-498c-904f-ed409f6c147f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:33.380755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3edf2-2ec9-498c-904f-ed409f6c147f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:33.381465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3edf2-2ec9-498c-904f-ed409f6c147f None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=d1d19d1439914eac9993bf31fa4c9384) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:33.381766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3edf2-2ec9-498c-904f-ed409f6c147f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:33.383189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3edf2-2ec9-498c-904f-ed409f6c147f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:33.388687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 605/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:16:33 2022] GET /identity/v3/role_assignments?user.id=d1d19d1439914eac9993bf31fa4c9384&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:35.260054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea12034-5aa2-43cd-bb97-463514817c80 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:35.260579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea12034-5aa2-43cd-bb97-463514817c80 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:35.260579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea12034-5aa2-43cd-bb97-463514817c80 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:35.262119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 615/1220] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:16:35.267578 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8453fb4-3b5b-47fc-a60b-00ebcd94c170 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:35.267988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8453fb4-3b5b-47fc-a60b-00ebcd94c170 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:35.268160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8453fb4-3b5b-47fc-a60b-00ebcd94c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:35.286346 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e8453fb4-3b5b-47fc-a60b-00ebcd94c170 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:16:35.287546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e8453fb4-3b5b-47fc-a60b-00ebcd94c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:16:35.354452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 606/1221] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:16:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:16:35.631297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea12034-5aa2-43cd-bb97-463514817c80 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:35.730001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea12034-5aa2-43cd-bb97-463514817c80 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:35.764737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e525-8112-4fc5-8ef0-e62eb73e2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:35.765341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e525-8112-4fc5-8ef0-e62eb73e2b15 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:35.765610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e525-8112-4fc5-8ef0-e62eb73e2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:35.765875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e525-8112-4fc5-8ef0-e62eb73e2b15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:35.775988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910e525-8112-4fc5-8ef0-e62eb73e2b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7910e525-8112-4fc5-8ef0-e62eb73e2b15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:16:35.780743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:35.781869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:35.783626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 616/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:16:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:35.789997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8453fb4-3b5b-47fc-a60b-00ebcd94c170 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:35.886104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8453fb4-3b5b-47fc-a60b-00ebcd94c170 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:35.910817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:35.921070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1e08a-8bd7-44bb-9402-8632fe6dcc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:35.921718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1e08a-8bd7-44bb-9402-8632fe6dcc51 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:35.921988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1e08a-8bd7-44bb-9402-8632fe6dcc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:35.922260 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1e08a-8bd7-44bb-9402-8632fe6dcc51 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:35.922912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1e08a-8bd7-44bb-9402-8632fe6dcc51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:35.923246 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1e08a-8bd7-44bb-9402-8632fe6dcc51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:35.924691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1e08a-8bd7-44bb-9402-8632fe6dcc51 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:35.932593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 607/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:16:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:35.938347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e525-8112-4fc5-8ef0-e62eb73e2b15 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:35.982372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:36.035949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e525-8112-4fc5-8ef0-e62eb73e2b15 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:36.068869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8508caa-a18d-4118-b567-b37eed01e932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:36.069488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8508caa-a18d-4118-b567-b37eed01e932 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:36.069762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8508caa-a18d-4118-b567-b37eed01e932 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:36.070032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8508caa-a18d-4118-b567-b37eed01e932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:36.080346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8508caa-a18d-4118-b567-b37eed01e932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:36.081771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8508caa-a18d-4118-b567-b37eed01e932 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a8508caa-a18d-4118-b567-b37eed01e932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:36.096700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:36.100808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:36.101953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:36.101953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:36.101953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:36.101953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 617/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:36.103656 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1e08a-8bd7-44bb-9402-8632fe6dcc51 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:36.202631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1e08a-8bd7-44bb-9402-8632fe6dcc51 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:36.236285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c845da-59a4-4781-b8d5-c0a2ca54b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:36.236888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c845da-59a4-4781-b8d5-c0a2ca54b3bf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:36.237164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c845da-59a4-4781-b8d5-c0a2ca54b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:36.237441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c845da-59a4-4781-b8d5-c0a2ca54b3bf None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:36.238077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c845da-59a4-4781-b8d5-c0a2ca54b3bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:36.238383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c845da-59a4-4781-b8d5-c0a2ca54b3bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:36.239740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c845da-59a4-4781-b8d5-c0a2ca54b3bf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:36.252465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 608/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:36.258959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8508caa-a18d-4118-b567-b37eed01e932 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:36.350122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:36.356600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8508caa-a18d-4118-b567-b37eed01e932 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:36.388920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2ac0f-64aa-4850-92ea-e417acc062d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:36.389534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2ac0f-64aa-4850-92ea-e417acc062d9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:36.389810 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2ac0f-64aa-4850-92ea-e417acc062d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:36.390077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2ac0f-64aa-4850-92ea-e417acc062d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:36.398096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2ac0f-64aa-4850-92ea-e417acc062d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:36.399535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2ac0f-64aa-4850-92ea-e417acc062d9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a4a2ac0f-64aa-4850-92ea-e417acc062d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:16:36.410562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:36.411749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:36.412773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 618/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:36.417523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c845da-59a4-4781-b8d5-c0a2ca54b3bf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:36.465146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:36.517476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c845da-59a4-4781-b8d5-c0a2ca54b3bf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:36.549728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38f3b-5000-47b1-b883-a79aa61aad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:36.550315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38f3b-5000-47b1-b883-a79aa61aad27 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:36.550591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38f3b-5000-47b1-b883-a79aa61aad27 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:36.550857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38f3b-5000-47b1-b883-a79aa61aad27 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:36.551559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc38f3b-5000-47b1-b883-a79aa61aad27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:36.551851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc38f3b-5000-47b1-b883-a79aa61aad27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:36.553286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc38f3b-5000-47b1-b883-a79aa61aad27 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:36.570120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 609/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Fri Sep 2 09:16:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:36.575737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2ac0f-64aa-4850-92ea-e417acc062d9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:36.674188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2ac0f-64aa-4850-92ea-e417acc062d9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:36.706852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557290a1-7f0f-43d2-9b90-21b883ed408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:36.707496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557290a1-7f0f-43d2-9b90-21b883ed408b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:36.707772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557290a1-7f0f-43d2-9b90-21b883ed408b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:36.708076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557290a1-7f0f-43d2-9b90-21b883ed408b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:36.725886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557290a1-7f0f-43d2-9b90-21b883ed408b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:36.725886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557290a1-7f0f-43d2-9b90-21b883ed408b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-557290a1-7f0f-43d2-9b90-21b883ed408b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:36.733494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:36.734592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:36.735524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:36.735524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:36.735524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:36.735524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 619/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:36.740971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38f3b-5000-47b1-b883-a79aa61aad27 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:36.840766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38f3b-5000-47b1-b883-a79aa61aad27 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:36.843188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:36.873803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c5a11-e898-4e8f-ac2e-3f58f14e1155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:36.874429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c5a11-e898-4e8f-ac2e-3f58f14e1155 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:36.874700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c5a11-e898-4e8f-ac2e-3f58f14e1155 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:36.874967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c5a11-e898-4e8f-ac2e-3f58f14e1155 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:36.875599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c5a11-e898-4e8f-ac2e-3f58f14e1155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:36.875909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c5a11-e898-4e8f-ac2e-3f58f14e1155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:36.877885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c5a11-e898-4e8f-ac2e-3f58f14e1155 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:36.889444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 610/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:36.895535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557290a1-7f0f-43d2-9b90-21b883ed408b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:36.905623 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:36.995058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557290a1-7f0f-43d2-9b90-21b883ed408b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:37.029265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e166e-f0b9-4070-bc76-b95c8182da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:37.029877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e166e-f0b9-4070-bc76-b95c8182da0f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:37.030284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e166e-f0b9-4070-bc76-b95c8182da0f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:37.030558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e166e-f0b9-4070-bc76-b95c8182da0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:37.037058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e166e-f0b9-4070-bc76-b95c8182da0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:37.038483 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e166e-f0b9-4070-bc76-b95c8182da0f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ea7e166e-f0b9-4070-bc76-b95c8182da0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:16:37.049533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:37.051674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:37.052839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:16:37.052839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:16:37.052839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:16:37.052839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:16:37.052839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:16:37.052839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:16:37.052839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:37.052839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:37.052839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 620/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:37.056700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c5a11-e898-4e8f-ac2e-3f58f14e1155 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:37.159609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c5a11-e898-4e8f-ac2e-3f58f14e1155 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:37.193190 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa39e9-8274-43cd-8c67-81ed1a75a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:37.193790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa39e9-8274-43cd-8c67-81ed1a75a61c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:37.194063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa39e9-8274-43cd-8c67-81ed1a75a61c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:37.194332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa39e9-8274-43cd-8c67-81ed1a75a61c None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:37.195004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa39e9-8274-43cd-8c67-81ed1a75a61c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:37.195299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa39e9-8274-43cd-8c67-81ed1a75a61c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:37.196778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa39e9-8274-43cd-8c67-81ed1a75a61c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:37.208951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 611/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:37.214877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e166e-f0b9-4070-bc76-b95c8182da0f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:37.280652 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:37.315492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e166e-f0b9-4070-bc76-b95c8182da0f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:37.348319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25089b3c-9d1e-4665-9f84-f4e4cca0135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:37.348966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25089b3c-9d1e-4665-9f84-f4e4cca0135f None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:37.349245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25089b3c-9d1e-4665-9f84-f4e4cca0135f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:37.349520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25089b3c-9d1e-4665-9f84-f4e4cca0135f None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/d1d19d1439914eac9993bf31fa4c9384/roles/8f47585e7ab1400689facb80e605e850` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:37.363667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25089b3c-9d1e-4665-9f84-f4e4cca0135f None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=d1d19d1439914eac9993bf31fa4c9384, role_id=8f47585e7ab1400689facb80e605e850)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:37.365170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25089b3c-9d1e-4665-9f84-f4e4cca0135f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:37.427659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 621/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:16:37 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/d1d19d1439914eac9993bf31fa4c9384/roles/8f47585e7ab1400689facb80e605e850 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:16:39.305222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5523f-0eb3-4db9-8612-a1d0e649518a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:39.305947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5523f-0eb3-4db9-8612-a1d0e649518a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:39.305947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5523f-0eb3-4db9-8612-a1d0e649518a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:39.307200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 612/1233] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:16:39.312442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e45f-b078-40a0-8ee7-736cf6f9830c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:39.312894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e45f-b078-40a0-8ee7-736cf6f9830c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:39.313005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e45f-b078-40a0-8ee7-736cf6f9830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:39.330597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8609e45f-b078-40a0-8ee7-736cf6f9830c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:16:39.331761 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8609e45f-b078-40a0-8ee7-736cf6f9830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:16:39.396787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 622/1234] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:16:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:16:39.664496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5523f-0eb3-4db9-8612-a1d0e649518a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:39.689081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:39.763817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5523f-0eb3-4db9-8612-a1d0e649518a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:39.797634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e35236-aff1-4b15-84fb-c22537fd3ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:39.798249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e35236-aff1-4b15-84fb-c22537fd3ddd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:39.798523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e35236-aff1-4b15-84fb-c22537fd3ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:39.798794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e35236-aff1-4b15-84fb-c22537fd3ddd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:39.808675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e35236-aff1-4b15-84fb-c22537fd3ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a8e35236-aff1-4b15-84fb-c22537fd3ddd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:16:39.813648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:39.814804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:39.815812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 613/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Fri Sep 2 09:16:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:39.821093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609e45f-b078-40a0-8ee7-736cf6f9830c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:39.866473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:39.917481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609e45f-b078-40a0-8ee7-736cf6f9830c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:39.949599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4995-100b-4ac8-a220-cb115a001ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:39.950192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4995-100b-4ac8-a220-cb115a001ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:39.950467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4995-100b-4ac8-a220-cb115a001ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:39.950741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4995-100b-4ac8-a220-cb115a001ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:39.951388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4995-100b-4ac8-a220-cb115a001ae1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:39.951754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4995-100b-4ac8-a220-cb115a001ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:39.953119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4995-100b-4ac8-a220-cb115a001ae1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:39.961400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 623/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Fri Sep 2 09:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:39.967303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e35236-aff1-4b15-84fb-c22537fd3ddd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:40.050043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:40.065893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e35236-aff1-4b15-84fb-c22537fd3ddd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:40.101182 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3e0fb-adbf-455c-add3-b9dae1d4b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:40.101801 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3e0fb-adbf-455c-add3-b9dae1d4b337 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:40.102071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3e0fb-adbf-455c-add3-b9dae1d4b337 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:40.102336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3e0fb-adbf-455c-add3-b9dae1d4b337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:40.112205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3e0fb-adbf-455c-add3-b9dae1d4b337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:40.113711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3e0fb-adbf-455c-add3-b9dae1d4b337 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-38d3e0fb-adbf-455c-add3-b9dae1d4b337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:40.128702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:40.129786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:40.130806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:40.130806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:40.130806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:40.130806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 614/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:40.136608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4995-100b-4ac8-a220-cb115a001ae1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:40.239247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4995-100b-4ac8-a220-cb115a001ae1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:40.247686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:40.272909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11104be5-fd40-480d-afb3-50b81e8e98c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:40.273504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11104be5-fd40-480d-afb3-50b81e8e98c6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:40.273780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11104be5-fd40-480d-afb3-50b81e8e98c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:40.274048 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11104be5-fd40-480d-afb3-50b81e8e98c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:40.274673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11104be5-fd40-480d-afb3-50b81e8e98c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:40.274970 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11104be5-fd40-480d-afb3-50b81e8e98c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:40.276392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11104be5-fd40-480d-afb3-50b81e8e98c6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:40.288715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 624/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:40.294447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3e0fb-adbf-455c-add3-b9dae1d4b337 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:40.393879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3e0fb-adbf-455c-add3-b9dae1d4b337 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:40.426732 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed101e6-c7c9-4260-8b73-8f0b92be2eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:40.427484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed101e6-c7c9-4260-8b73-8f0b92be2eaa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:40.427757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed101e6-c7c9-4260-8b73-8f0b92be2eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:40.428061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed101e6-c7c9-4260-8b73-8f0b92be2eaa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:40.430609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:40.435518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed101e6-c7c9-4260-8b73-8f0b92be2eaa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:40.436980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed101e6-c7c9-4260-8b73-8f0b92be2eaa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-fed101e6-c7c9-4260-8b73-8f0b92be2eaa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:16:40.448489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:40.450957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:40.452196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 615/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:40.455535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11104be5-fd40-480d-afb3-50b81e8e98c6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:40.551645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11104be5-fd40-480d-afb3-50b81e8e98c6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:40.587395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02dfb-4e1a-4c5a-99f6-512770427686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:40.588002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02dfb-4e1a-4c5a-99f6-512770427686 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:40.588276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02dfb-4e1a-4c5a-99f6-512770427686 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:40.588542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02dfb-4e1a-4c5a-99f6-512770427686 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:40.589245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f02dfb-4e1a-4c5a-99f6-512770427686 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:40.589541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f02dfb-4e1a-4c5a-99f6-512770427686 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:40.590946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f02dfb-4e1a-4c5a-99f6-512770427686 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:40.607171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 625/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Fri Sep 2 09:16:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:40.613717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed101e6-c7c9-4260-8b73-8f0b92be2eaa None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:40.712042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed101e6-c7c9-4260-8b73-8f0b92be2eaa None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:40.745352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb39b49-31c3-48a7-8735-c46bc81a23f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:40.745975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb39b49-31c3-48a7-8735-c46bc81a23f0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:40.746351 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb39b49-31c3-48a7-8735-c46bc81a23f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:40.746624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb39b49-31c3-48a7-8735-c46bc81a23f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:40.806198 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:40.812550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb39b49-31c3-48a7-8735-c46bc81a23f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:40.813984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb39b49-31c3-48a7-8735-c46bc81a23f0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:40.910411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 616/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:16:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:16:40.916394 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02dfb-4e1a-4c5a-99f6-512770427686 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:40.943366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:41.013192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02dfb-4e1a-4c5a-99f6-512770427686 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:41.047713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f474f32-a24f-498a-b1b6-edf52149c6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:41.048357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f474f32-a24f-498a-b1b6-edf52149c6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:41.048650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f474f32-a24f-498a-b1b6-edf52149c6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:41.048916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f474f32-a24f-498a-b1b6-edf52149c6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:41.058507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f474f32-a24f-498a-b1b6-edf52149c6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:41.059873 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f474f32-a24f-498a-b1b6-edf52149c6a6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8f474f32-a24f-498a-b1b6-edf52149c6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:41.073805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:41.074904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:41.075805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:41.075805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:41.075805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:41.075805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 626/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:41.081124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb39b49-31c3-48a7-8735-c46bc81a23f0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:41.174855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:41.180520 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb39b49-31c3-48a7-8735-c46bc81a23f0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:41.213554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cf162-8406-4c99-9644-a4a3ad282bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:41.214149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf162-8406-4c99-9644-a4a3ad282bdb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:41.214427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf162-8406-4c99-9644-a4a3ad282bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:41.214700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf162-8406-4c99-9644-a4a3ad282bdb None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:41.215353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cf162-8406-4c99-9644-a4a3ad282bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:41.215655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cf162-8406-4c99-9644-a4a3ad282bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:41.217095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cf162-8406-4c99-9644-a4a3ad282bdb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:41.228578 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 617/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:16:41.234247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f474f32-a24f-498a-b1b6-edf52149c6a6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:41.310702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:41.331070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f474f32-a24f-498a-b1b6-edf52149c6a6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:41.362894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d5d5-1d8d-48cb-b738-1970d18700c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:41.363505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d5d5-1d8d-48cb-b738-1970d18700c1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:41.363777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d5d5-1d8d-48cb-b738-1970d18700c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:41.364075 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d5d5-1d8d-48cb-b738-1970d18700c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:41.370287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34d5d5-1d8d-48cb-b738-1970d18700c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:41.371694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34d5d5-1d8d-48cb-b738-1970d18700c1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9a34d5d5-1d8d-48cb-b738-1970d18700c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:16:41.382504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:41.383653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:41.384871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:16:41.384871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:16:41.384871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:16:41.384871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:16:41.384871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:16:41.384871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:16:41.384871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:41.384871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:41.388178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 627/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:41.389642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cf162-8406-4c99-9644-a4a3ad282bdb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:41.489024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cf162-8406-4c99-9644-a4a3ad282bdb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:41.522484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1517d1-a8f1-4a81-89ee-3b884b480ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:41.523078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1517d1-a8f1-4a81-89ee-3b884b480ecf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:41.523360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1517d1-a8f1-4a81-89ee-3b884b480ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:41.523631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1517d1-a8f1-4a81-89ee-3b884b480ecf None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:41.524382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1517d1-a8f1-4a81-89ee-3b884b480ecf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:41.524678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1517d1-a8f1-4a81-89ee-3b884b480ecf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:41.526100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1517d1-a8f1-4a81-89ee-3b884b480ecf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:41.537955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 618/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:41.544109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d5d5-1d8d-48cb-b738-1970d18700c1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:41.643490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d5d5-1d8d-48cb-b738-1970d18700c1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:41.675656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac6315-3b5e-4d54-aec5-627cfa86fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:41.676272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac6315-3b5e-4d54-aec5-627cfa86fdbf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:41.676545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac6315-3b5e-4d54-aec5-627cfa86fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:41.676812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac6315-3b5e-4d54-aec5-627cfa86fdbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:41.677519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac6315-3b5e-4d54-aec5-627cfa86fdbf None admin] RBAC: Adding query filter params (role.id=8f47585e7ab1400689facb80e605e850, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=d1d19d1439914eac9993bf31fa4c9384) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:41.677818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac6315-3b5e-4d54-aec5-627cfa86fdbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:41.679230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac6315-3b5e-4d54-aec5-627cfa86fdbf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:41.684989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 628/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:16:41 2022] GET /identity/v3/role_assignments?user.id=d1d19d1439914eac9993bf31fa4c9384&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=8f47585e7ab1400689facb80e605e850 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:16:43.666484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4524c-6b66-42e8-8029-67ce14625eec None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:43.667124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4524c-6b66-42e8-8029-67ce14625eec None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:43.667124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4524c-6b66-42e8-8029-67ce14625eec None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:43.668401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 619/1247] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:16:43.673617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdae410-dc35-490d-98d6-afe6e5fdf567 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:43.675479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdae410-dc35-490d-98d6-afe6e5fdf567 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:43.675479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdae410-dc35-490d-98d6-afe6e5fdf567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:43.681220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:43.694570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3bdae410-dc35-490d-98d6-afe6e5fdf567 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:16:43.695773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3bdae410-dc35-490d-98d6-afe6e5fdf567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:16:43.761895 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 629/1248] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:16:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:16:44.028137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4524c-6b66-42e8-8029-67ce14625eec None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:44.046765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:44.127200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4524c-6b66-42e8-8029-67ce14625eec None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:44.161913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e0ad8-90b6-4254-8dcd-888733fe7798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:44.162526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e0ad8-90b6-4254-8dcd-888733fe7798 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:44.162796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e0ad8-90b6-4254-8dcd-888733fe7798 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:44.163063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e0ad8-90b6-4254-8dcd-888733fe7798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:44.172952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e0ad8-90b6-4254-8dcd-888733fe7798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-803e0ad8-90b6-4254-8dcd-888733fe7798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:16:44.177796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:44.178952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:44.180073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 620/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:16:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:44.184961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdae410-dc35-490d-98d6-afe6e5fdf567 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:44.281266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdae410-dc35-490d-98d6-afe6e5fdf567 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:44.310116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:44.315086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e848db-7c50-4ad9-9c87-4a64131ef94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:44.315719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e848db-7c50-4ad9-9c87-4a64131ef94b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:44.316030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e848db-7c50-4ad9-9c87-4a64131ef94b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:44.316302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e848db-7c50-4ad9-9c87-4a64131ef94b None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:44.316954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e848db-7c50-4ad9-9c87-4a64131ef94b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:44.317252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e848db-7c50-4ad9-9c87-4a64131ef94b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:44.318631 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e848db-7c50-4ad9-9c87-4a64131ef94b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:44.326398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 630/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:16:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:44.332751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e0ad8-90b6-4254-8dcd-888733fe7798 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:44.413788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:44.436250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e0ad8-90b6-4254-8dcd-888733fe7798 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:44.469473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290afba-303b-46ca-973c-9b08f563597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:44.470087 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290afba-303b-46ca-973c-9b08f563597e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:44.470360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290afba-303b-46ca-973c-9b08f563597e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:44.470627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290afba-303b-46ca-973c-9b08f563597e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:44.480193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290afba-303b-46ca-973c-9b08f563597e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:44.481623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290afba-303b-46ca-973c-9b08f563597e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1290afba-303b-46ca-973c-9b08f563597e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:44.495661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:44.496879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:44.498109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:44.498109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:44.498109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:44.498109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 621/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:44.503197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e848db-7c50-4ad9-9c87-4a64131ef94b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:44.600506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e848db-7c50-4ad9-9c87-4a64131ef94b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:44.632683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875ad01-5692-4c4a-8987-fbe46e76b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:44.633274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875ad01-5692-4c4a-8987-fbe46e76b370 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:44.633552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875ad01-5692-4c4a-8987-fbe46e76b370 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:44.633829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875ad01-5692-4c4a-8987-fbe46e76b370 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:44.634458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875ad01-5692-4c4a-8987-fbe46e76b370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:44.634761 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875ad01-5692-4c4a-8987-fbe46e76b370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:44.636141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875ad01-5692-4c4a-8987-fbe46e76b370 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:44.648240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 631/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:44.653965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290afba-303b-46ca-973c-9b08f563597e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:44.750974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290afba-303b-46ca-973c-9b08f563597e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:44.776871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:44.784396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4075d-f118-4d6b-8595-ec52089f078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:44.785003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4075d-f118-4d6b-8595-ec52089f078f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:44.785275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4075d-f118-4d6b-8595-ec52089f078f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:44.785539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4075d-f118-4d6b-8595-ec52089f078f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:44.792544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4075d-f118-4d6b-8595-ec52089f078f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:44.794074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4075d-f118-4d6b-8595-ec52089f078f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bcf4075d-f118-4d6b-8595-ec52089f078f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:16:44.805342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:44.806376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:44.807407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 622/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:44.815716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875ad01-5692-4c4a-8987-fbe46e76b370 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:44.870392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:44.913214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875ad01-5692-4c4a-8987-fbe46e76b370 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:44.947186 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fed25-f907-49ed-809a-b46ccaed1fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:44.947785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fed25-f907-49ed-809a-b46ccaed1fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:44.948087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fed25-f907-49ed-809a-b46ccaed1fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:44.948355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fed25-f907-49ed-809a-b46ccaed1fa6 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:44.949060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fed25-f907-49ed-809a-b46ccaed1fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:44.949374 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fed25-f907-49ed-809a-b46ccaed1fa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:44.950765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fed25-f907-49ed-809a-b46ccaed1fa6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:44.966918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 632/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Fri Sep 2 09:16:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:44.972841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4075d-f118-4d6b-8595-ec52089f078f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:45.073624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4075d-f118-4d6b-8595-ec52089f078f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:45.106362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263560f-74fa-48cc-895e-e91c62d006db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:45.106965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263560f-74fa-48cc-895e-e91c62d006db None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:45.107243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263560f-74fa-48cc-895e-e91c62d006db None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:45.107516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263560f-74fa-48cc-895e-e91c62d006db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:45.162016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:45.173812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263560f-74fa-48cc-895e-e91c62d006db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:45.175799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263560f-74fa-48cc-895e-e91c62d006db None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:45.272221 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 623/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:16:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:16:45.278083 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fed25-f907-49ed-809a-b46ccaed1fa6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:45.376381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fed25-f907-49ed-809a-b46ccaed1fa6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:45.389208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:45.409403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc31322-e70f-4843-894b-2b6ca37f1a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:45.410269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31322-e70f-4843-894b-2b6ca37f1a1e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:45.410269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31322-e70f-4843-894b-2b6ca37f1a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:45.410577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31322-e70f-4843-894b-2b6ca37f1a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:45.420264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc31322-e70f-4843-894b-2b6ca37f1a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:45.421642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc31322-e70f-4843-894b-2b6ca37f1a1e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9bc31322-e70f-4843-894b-2b6ca37f1a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:45.437162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:45.443065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:45.444241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:45.444241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:45.444241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:45.444241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 633/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:45.444543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263560f-74fa-48cc-895e-e91c62d006db None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:45.528256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:45.540199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263560f-74fa-48cc-895e-e91c62d006db None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:45.572737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45b5c1-a2b2-409a-96c6-d8dc03f59379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:45.573333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45b5c1-a2b2-409a-96c6-d8dc03f59379 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:45.573607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45b5c1-a2b2-409a-96c6-d8dc03f59379 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:45.573874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45b5c1-a2b2-409a-96c6-d8dc03f59379 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:45.574501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45b5c1-a2b2-409a-96c6-d8dc03f59379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:45.574795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45b5c1-a2b2-409a-96c6-d8dc03f59379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:45.576175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45b5c1-a2b2-409a-96c6-d8dc03f59379 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:45.587615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 624/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:16:45.593306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc31322-e70f-4843-894b-2b6ca37f1a1e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:45.691576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc31322-e70f-4843-894b-2b6ca37f1a1e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:45.724925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c24d7-81e3-4360-992e-190e58ce8e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:45.725553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c24d7-81e3-4360-992e-190e58ce8e61 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:45.725826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c24d7-81e3-4360-992e-190e58ce8e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:45.726095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c24d7-81e3-4360-992e-190e58ce8e61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:45.732679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c24d7-81e3-4360-992e-190e58ce8e61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:45.734104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c24d7-81e3-4360-992e-190e58ce8e61 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2f3c24d7-81e3-4360-992e-190e58ce8e61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:16:45.745254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:45.746307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:45.747220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:16:45.747220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:16:45.747220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:16:45.747220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:16:45.747220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:16:45.747220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:16:45.747220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:45.747220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:45.747220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 634/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:45.752314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45b5c1-a2b2-409a-96c6-d8dc03f59379 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:45.852217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45b5c1-a2b2-409a-96c6-d8dc03f59379 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:45.883807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c3115-3fa6-401d-9f29-a7075f2d24f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:45.884450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3115-3fa6-401d-9f29-a7075f2d24f6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:45.884730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3115-3fa6-401d-9f29-a7075f2d24f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:45.884993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3115-3fa6-401d-9f29-a7075f2d24f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:45.885671 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c3115-3fa6-401d-9f29-a7075f2d24f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:45.885966 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c3115-3fa6-401d-9f29-a7075f2d24f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:45.887375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c3115-3fa6-401d-9f29-a7075f2d24f6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:45.900430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 625/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:45.906661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c24d7-81e3-4360-992e-190e58ce8e61 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:45.932109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:46.001544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c24d7-81e3-4360-992e-190e58ce8e61 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:46.034221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4c9cb-0ae7-4035-8fe9-eb3c110b63d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:46.034983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c9cb-0ae7-4035-8fe9-eb3c110b63d6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:46.035305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c9cb-0ae7-4035-8fe9-eb3c110b63d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:46.036183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c9cb-0ae7-4035-8fe9-eb3c110b63d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:46.036896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4c9cb-0ae7-4035-8fe9-eb3c110b63d6 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=d1d19d1439914eac9993bf31fa4c9384) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:46.037193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4c9cb-0ae7-4035-8fe9-eb3c110b63d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:46.038607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4c9cb-0ae7-4035-8fe9-eb3c110b63d6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:46.043720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 635/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:16:45 2022] GET /identity/v3/role_assignments?user.id=d1d19d1439914eac9993bf31fa4c9384&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=04d1bc62091440e189989e4b973a6627 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:47.912364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190abed5-7b2f-4024-a97f-4ab67a1c1503 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:47.912895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190abed5-7b2f-4024-a97f-4ab67a1c1503 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:47.912895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190abed5-7b2f-4024-a97f-4ab67a1c1503 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:47.914361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 626/1261] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:16:47.919406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f02f2-82f7-49ee-9701-698a04aea02f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:47.919846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f02f2-82f7-49ee-9701-698a04aea02f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:47.919973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f02f2-82f7-49ee-9701-698a04aea02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:47.937677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e53f02f2-82f7-49ee-9701-698a04aea02f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:16:47.938836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e53f02f2-82f7-49ee-9701-698a04aea02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:16:48.004860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 636/1262] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:16:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:16:48.272657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190abed5-7b2f-4024-a97f-4ab67a1c1503 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:48.283369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:48.371697 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190abed5-7b2f-4024-a97f-4ab67a1c1503 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:48.405869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b83c4-7e7e-4c38-a868-9b8cbb1fed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:48.406480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b83c4-7e7e-4c38-a868-9b8cbb1fed62 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:48.406753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b83c4-7e7e-4c38-a868-9b8cbb1fed62 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:48.407020 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b83c4-7e7e-4c38-a868-9b8cbb1fed62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:48.416764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b83c4-7e7e-4c38-a868-9b8cbb1fed62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-402b83c4-7e7e-4c38-a868-9b8cbb1fed62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:16:48.421834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:48.422763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:48.423598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 627/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:16:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:48.429128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f02f2-82f7-49ee-9701-698a04aea02f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:48.447898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:48.526492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f02f2-82f7-49ee-9701-698a04aea02f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:48.559575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64587a-12ab-48a0-bd81-d3a1b2eed8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:48.560204 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64587a-12ab-48a0-bd81-d3a1b2eed8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:48.560486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64587a-12ab-48a0-bd81-d3a1b2eed8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:48.560759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64587a-12ab-48a0-bd81-d3a1b2eed8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:48.561414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64587a-12ab-48a0-bd81-d3a1b2eed8e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:48.561716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64587a-12ab-48a0-bd81-d3a1b2eed8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:48.563088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64587a-12ab-48a0-bd81-d3a1b2eed8e6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:48.571716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 637/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:16:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:48.577438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b83c4-7e7e-4c38-a868-9b8cbb1fed62 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:48.645463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:48.678063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b83c4-7e7e-4c38-a868-9b8cbb1fed62 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:48.710917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ece6d-efcd-4a22-a68a-7f45eb783478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:48.711531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ece6d-efcd-4a22-a68a-7f45eb783478 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:48.711803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ece6d-efcd-4a22-a68a-7f45eb783478 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:48.712099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ece6d-efcd-4a22-a68a-7f45eb783478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:48.722923 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ece6d-efcd-4a22-a68a-7f45eb783478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:48.724435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ece6d-efcd-4a22-a68a-7f45eb783478 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8e7ece6d-efcd-4a22-a68a-7f45eb783478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:48.739233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:48.740431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:48.741485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:48.741485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:48.741485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:48.741485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 628/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 09:16:48.746205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64587a-12ab-48a0-bd81-d3a1b2eed8e6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:48.828910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:48.847480 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64587a-12ab-48a0-bd81-d3a1b2eed8e6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:48.880961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6a941-5bec-4e2d-900d-463bef8947e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:48.881544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a941-5bec-4e2d-900d-463bef8947e7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:48.881820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a941-5bec-4e2d-900d-463bef8947e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:48.882090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a941-5bec-4e2d-900d-463bef8947e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:48.882722 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6a941-5bec-4e2d-900d-463bef8947e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:48.883020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6a941-5bec-4e2d-900d-463bef8947e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:48.884420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6a941-5bec-4e2d-900d-463bef8947e7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:48.897247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 638/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:48.903039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ece6d-efcd-4a22-a68a-7f45eb783478 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:49.002690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ece6d-efcd-4a22-a68a-7f45eb783478 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:49.021980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:49.035975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037272-dbb6-47c1-b797-364b0ba0450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:49.036632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037272-dbb6-47c1-b797-364b0ba0450b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:49.036909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037272-dbb6-47c1-b797-364b0ba0450b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:49.037180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037272-dbb6-47c1-b797-364b0ba0450b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:49.044828 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84037272-dbb6-47c1-b797-364b0ba0450b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:49.046263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84037272-dbb6-47c1-b797-364b0ba0450b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-84037272-dbb6-47c1-b797-364b0ba0450b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:16:49.057919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:49.059077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:49.060298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 629/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:49.065050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6a941-5bec-4e2d-900d-463bef8947e7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:49.162271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6a941-5bec-4e2d-900d-463bef8947e7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:49.195578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcff9d6-1bef-41c2-8757-9d20cd6173d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:49.196203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcff9d6-1bef-41c2-8757-9d20cd6173d3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:49.196479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcff9d6-1bef-41c2-8757-9d20cd6173d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:49.196745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcff9d6-1bef-41c2-8757-9d20cd6173d3 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:49.197449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcff9d6-1bef-41c2-8757-9d20cd6173d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:49.197746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcff9d6-1bef-41c2-8757-9d20cd6173d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:49.199153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcff9d6-1bef-41c2-8757-9d20cd6173d3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:49.207668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:49.215931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 639/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Fri Sep 2 09:16:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:49.222146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037272-dbb6-47c1-b797-364b0ba0450b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:49.322269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037272-dbb6-47c1-b797-364b0ba0450b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:49.355490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b26fa7-8e18-4919-9e64-3bc21218813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:49.356125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b26fa7-8e18-4919-9e64-3bc21218813d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:49.356397 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b26fa7-8e18-4919-9e64-3bc21218813d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:49.356660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b26fa7-8e18-4919-9e64-3bc21218813d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:49.366751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b26fa7-8e18-4919-9e64-3bc21218813d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:49.368209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b26fa7-8e18-4919-9e64-3bc21218813d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a1b26fa7-8e18-4919-9e64-3bc21218813d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:49.382169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:49.383296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:49.384392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:49.384392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:49.384392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:49.384392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 630/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:49.389438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcff9d6-1bef-41c2-8757-9d20cd6173d3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:49.487485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcff9d6-1bef-41c2-8757-9d20cd6173d3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:49.520710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259b653-2c9e-4b9c-9543-83a3f204a63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:49.521307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259b653-2c9e-4b9c-9543-83a3f204a63d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:49.521580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259b653-2c9e-4b9c-9543-83a3f204a63d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:49.521849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259b653-2c9e-4b9c-9543-83a3f204a63d None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:49.522476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259b653-2c9e-4b9c-9543-83a3f204a63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:49.522773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259b653-2c9e-4b9c-9543-83a3f204a63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:49.524162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259b653-2c9e-4b9c-9543-83a3f204a63d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:49.535829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 640/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:49.541659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b26fa7-8e18-4919-9e64-3bc21218813d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:49.572569 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:49.638479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b26fa7-8e18-4919-9e64-3bc21218813d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:49.672304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d57007-fee4-4c7d-a496-47c7f1e367d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:49.672992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57007-fee4-4c7d-a496-47c7f1e367d6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:49.673324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57007-fee4-4c7d-a496-47c7f1e367d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:49.673635 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57007-fee4-4c7d-a496-47c7f1e367d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:49.679982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d57007-fee4-4c7d-a496-47c7f1e367d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:49.684814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d57007-fee4-4c7d-a496-47c7f1e367d6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d6d57007-fee4-4c7d-a496-47c7f1e367d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:16:49.692824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:49.693883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:49.694980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:16:49.694980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:16:49.694980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:16:49.694980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:16:49.694980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:16:49.694980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:16:49.694980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:49.694980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:49.694980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 631/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:49.699861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259b653-2c9e-4b9c-9543-83a3f204a63d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:49.758671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:49.799318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259b653-2c9e-4b9c-9543-83a3f204a63d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:49.833348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5834156-87f9-469a-a157-4341e7a541bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:49.833946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834156-87f9-469a-a157-4341e7a541bc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:49.834222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834156-87f9-469a-a157-4341e7a541bc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:49.834490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834156-87f9-469a-a157-4341e7a541bc None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:49.835172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5834156-87f9-469a-a157-4341e7a541bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:49.835474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5834156-87f9-469a-a157-4341e7a541bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:49.836926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5834156-87f9-469a-a157-4341e7a541bc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:49.848843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 641/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:49.854893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d57007-fee4-4c7d-a496-47c7f1e367d6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:49.946834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:49.956126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d57007-fee4-4c7d-a496-47c7f1e367d6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:49.988590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2beaaa-a3f5-4ce7-b2a5-53fde37ca37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:49.989231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2beaaa-a3f5-4ce7-b2a5-53fde37ca37f None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:49.989506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2beaaa-a3f5-4ce7-b2a5-53fde37ca37f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:49.989777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2beaaa-a3f5-4ce7-b2a5-53fde37ca37f None admin] PATH_INFO: `/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/d1d19d1439914eac9993bf31fa4c9384/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:49.991662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2beaaa-a3f5-4ce7-b2a5-53fde37ca37f None admin] RBAC: Authorizing `identity:create_grant(project_id=b917be6587a5413bae8786a9c2e5a9df, user_id=d1d19d1439914eac9993bf31fa4c9384, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:49.993110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2beaaa-a3f5-4ce7-b2a5-53fde37ca37f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:50.081148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 632/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Fri Sep 2 09:16:49 2022] PUT /identity/v3/projects/b917be6587a5413bae8786a9c2e5a9df/users/d1d19d1439914eac9993bf31fa4c9384/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:16:51.937393 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8850-ec21-41d8-bd44-a4e2013e5033 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:51.937992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8850-ec21-41d8-bd44-a4e2013e5033 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:51.937992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8850-ec21-41d8-bd44-a4e2013e5033 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:51.939272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 642/1274] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:16:51.944530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34300915-4345-46cc-b8b0-559755e710ee None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:51.949773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34300915-4345-46cc-b8b0-559755e710ee None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:51.949773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34300915-4345-46cc-b8b0-559755e710ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:51.963511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-34300915-4345-46cc-b8b0-559755e710ee None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:16:51.964706 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-34300915-4345-46cc-b8b0-559755e710ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:16:52.030516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 633/1275] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:16:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:16:52.298580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8850-ec21-41d8-bd44-a4e2013e5033 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:52.397707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8850-ec21-41d8-bd44-a4e2013e5033 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:52.414823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:52.430829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12925779-7834-4dfd-a283-9282f9663873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:52.431458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12925779-7834-4dfd-a283-9282f9663873 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:52.431718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12925779-7834-4dfd-a283-9282f9663873 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:52.432014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12925779-7834-4dfd-a283-9282f9663873 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:52.441762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12925779-7834-4dfd-a283-9282f9663873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-12925779-7834-4dfd-a283-9282f9663873 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 09:16:52.446641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:52.452278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:52.453421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 643/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Fri Sep 2 09:16:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:52.454291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34300915-4345-46cc-b8b0-559755e710ee None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:52.532424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:52.550368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34300915-4345-46cc-b8b0-559755e710ee None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:52.583105 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551ca2-252b-464f-9c9c-9867e6feac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:52.583704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551ca2-252b-464f-9c9c-9867e6feac39 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:52.584022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551ca2-252b-464f-9c9c-9867e6feac39 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:52.584298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551ca2-252b-464f-9c9c-9867e6feac39 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:52.584951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb551ca2-252b-464f-9c9c-9867e6feac39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:52.585256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb551ca2-252b-464f-9c9c-9867e6feac39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:52.586648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb551ca2-252b-464f-9c9c-9867e6feac39 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:52.594469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 634/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Fri Sep 2 09:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:16:52.600608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12925779-7834-4dfd-a283-9282f9663873 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:52.699080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12925779-7834-4dfd-a283-9282f9663873 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:52.732348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54513a-5122-4b0e-83bf-3d425d65505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:52.732952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54513a-5122-4b0e-83bf-3d425d65505e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:52.733224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54513a-5122-4b0e-83bf-3d425d65505e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:52.733486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54513a-5122-4b0e-83bf-3d425d65505e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:52.743213 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54513a-5122-4b0e-83bf-3d425d65505e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:52.744702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54513a-5122-4b0e-83bf-3d425d65505e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0c54513a-5122-4b0e-83bf-3d425d65505e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:52.759457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:52.760617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:52.761750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:52.761750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:52.761750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:52.761750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 644/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:52.766695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551ca2-252b-464f-9c9c-9867e6feac39 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:52.864200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551ca2-252b-464f-9c9c-9867e6feac39 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:52.897665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b341c1a-5108-4e9a-9b86-739f1be168b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:52.898257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b341c1a-5108-4e9a-9b86-739f1be168b1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:52.898531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b341c1a-5108-4e9a-9b86-739f1be168b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:52.898798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b341c1a-5108-4e9a-9b86-739f1be168b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:52.899425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b341c1a-5108-4e9a-9b86-739f1be168b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:52.899722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b341c1a-5108-4e9a-9b86-739f1be168b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:52.901106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b341c1a-5108-4e9a-9b86-739f1be168b1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:52.912702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 635/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:52.918416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54513a-5122-4b0e-83bf-3d425d65505e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:52.948620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:53.014873 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54513a-5122-4b0e-83bf-3d425d65505e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:53.046925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087690f9-bac1-465c-b41b-cfde44432a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:53.047530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087690f9-bac1-465c-b41b-cfde44432a95 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:53.047805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087690f9-bac1-465c-b41b-cfde44432a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:53.048103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087690f9-bac1-465c-b41b-cfde44432a95 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:53.056833 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087690f9-bac1-465c-b41b-cfde44432a95 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:53.058199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087690f9-bac1-465c-b41b-cfde44432a95 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-087690f9-bac1-465c-b41b-cfde44432a95 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 09:16:53.070194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:53.071294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:53.072497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 645/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:53.077040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b341c1a-5108-4e9a-9b86-739f1be168b1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:53.080968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:53.172007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b341c1a-5108-4e9a-9b86-739f1be168b1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:53.205714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bf9b2-e6a3-47aa-8cb0-ad2f107ae513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:53.206332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bf9b2-e6a3-47aa-8cb0-ad2f107ae513 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:53.215319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bf9b2-e6a3-47aa-8cb0-ad2f107ae513 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:53.215319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bf9b2-e6a3-47aa-8cb0-ad2f107ae513 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:53.215319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bf9b2-e6a3-47aa-8cb0-ad2f107ae513 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:53.215319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bf9b2-e6a3-47aa-8cb0-ad2f107ae513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:53.215319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bf9b2-e6a3-47aa-8cb0-ad2f107ae513 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:53.225781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 636/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Fri Sep 2 09:16:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:53.231523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087690f9-bac1-465c-b41b-cfde44432a95 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:53.322641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:53.331992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087690f9-bac1-465c-b41b-cfde44432a95 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:53.364076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e688f0-56de-4735-bf60-85d3e8417d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:53.364673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e688f0-56de-4735-bf60-85d3e8417d29 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:53.364950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e688f0-56de-4735-bf60-85d3e8417d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:53.365224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e688f0-56de-4735-bf60-85d3e8417d29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:53.430534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e688f0-56de-4735-bf60-85d3e8417d29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:53.431931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e688f0-56de-4735-bf60-85d3e8417d29 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:53.517165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:53.526789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 646/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Fri Sep 2 09:16:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 09:16:53.532630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bf9b2-e6a3-47aa-8cb0-ad2f107ae513 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:53.593066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:53.630365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bf9b2-e6a3-47aa-8cb0-ad2f107ae513 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:53.663059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bed54-ebc3-47a5-8f14-0f328256d7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:53.663675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bed54-ebc3-47a5-8f14-0f328256d7ec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:53.663977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bed54-ebc3-47a5-8f14-0f328256d7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:53.664249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bed54-ebc3-47a5-8f14-0f328256d7ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:53.673767 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bed54-ebc3-47a5-8f14-0f328256d7ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:53.675767 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bed54-ebc3-47a5-8f14-0f328256d7ec None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-0c7bed54-ebc3-47a5-8f14-0f328256d7ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 09:16:53.689927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:53.691013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 09:16:53.692009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 09:16:53.692009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 09:16:53.692009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:53.692009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 637/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:53.696758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e688f0-56de-4735-bf60-85d3e8417d29 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:53.794812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e688f0-56de-4735-bf60-85d3e8417d29 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:53.827863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49ac8b-4a53-431d-8ec7-78d640f8dd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:53.828528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49ac8b-4a53-431d-8ec7-78d640f8dd0f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:53.828805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49ac8b-4a53-431d-8ec7-78d640f8dd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:53.829074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49ac8b-4a53-431d-8ec7-78d640f8dd0f None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:53.829703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49ac8b-4a53-431d-8ec7-78d640f8dd0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:53.830001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49ac8b-4a53-431d-8ec7-78d640f8dd0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:53.831911 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49ac8b-4a53-431d-8ec7-78d640f8dd0f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:53.844289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 647/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Fri Sep 2 09:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:53.850534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bed54-ebc3-47a5-8f14-0f328256d7ec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:53.950672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bed54-ebc3-47a5-8f14-0f328256d7ec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:53.964423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:53.984252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71c682-6aa6-4109-9e16-ecd2e53b27c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:53.984874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71c682-6aa6-4109-9e16-ecd2e53b27c3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:53.985149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71c682-6aa6-4109-9e16-ecd2e53b27c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:53.985416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71c682-6aa6-4109-9e16-ecd2e53b27c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:53.992063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71c682-6aa6-4109-9e16-ecd2e53b27c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:53.993570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71c682-6aa6-4109-9e16-ecd2e53b27c3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8b71c682-6aa6-4109-9e16-ecd2e53b27c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 09:16:54.005010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:54.006136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:54.007218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 09:16:54.007218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 09:16:54.007218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 09:16:54.007218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 09:16:54.007218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 09:16:54.007218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 09:16:54.007218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 09:16:54.007218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 02 09:16:54.007218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 638/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Fri Sep 2 09:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:54.012076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49ac8b-4a53-431d-8ec7-78d640f8dd0f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:54.062281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:54.111158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49ac8b-4a53-431d-8ec7-78d640f8dd0f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:54.145128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b905c-8889-4de9-94bf-5b71af7de01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:54.145762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b905c-8889-4de9-94bf-5b71af7de01f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:54.146036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b905c-8889-4de9-94bf-5b71af7de01f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:54.146306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b905c-8889-4de9-94bf-5b71af7de01f None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:54.146986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b905c-8889-4de9-94bf-5b71af7de01f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:54.147288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b905c-8889-4de9-94bf-5b71af7de01f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:54.148740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b905c-8889-4de9-94bf-5b71af7de01f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:54.161057 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 648/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Fri Sep 2 09:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:54.167409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71c682-6aa6-4109-9e16-ecd2e53b27c3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:54.269423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71c682-6aa6-4109-9e16-ecd2e53b27c3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:54.301461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df67adc-010b-4ce8-8023-ace52bafb6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:54.302054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67adc-010b-4ce8-8023-ace52bafb6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:54.302333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67adc-010b-4ce8-8023-ace52bafb6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:54.302608 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67adc-010b-4ce8-8023-ace52bafb6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:54.303321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df67adc-010b-4ce8-8023-ace52bafb6a9 None admin] RBAC: Adding query filter params (role.id=04d1bc62091440e189989e4b973a6627, scope.project.id=b917be6587a5413bae8786a9c2e5a9df, user.id=d1d19d1439914eac9993bf31fa4c9384) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:54.303625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df67adc-010b-4ce8-8023-ace52bafb6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:54.305090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df67adc-010b-4ce8-8023-ace52bafb6a9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:54.310706 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 639/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Fri Sep 2 09:16:54 2022] GET /identity/v3/role_assignments?user.id=d1d19d1439914eac9993bf31fa4c9384&scope.project.id=b917be6587a5413bae8786a9c2e5a9df&role.id=04d1bc62091440e189989e4b973a6627 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:56.241245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415f9e-0fc1-447e-93f4-e54d74905e29 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:56.241796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415f9e-0fc1-447e-93f4-e54d74905e29 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:56.241796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415f9e-0fc1-447e-93f4-e54d74905e29 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:56.243157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 649/1288] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:16:56.248191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0144e2-b753-4dd3-b712-bf56dda906c7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:56.249148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0144e2-b753-4dd3-b712-bf56dda906c7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:56.249148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0144e2-b753-4dd3-b712-bf56dda906c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:56.266776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1b0144e2-b753-4dd3-b712-bf56dda906c7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:16:56.268107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1b0144e2-b753-4dd3-b712-bf56dda906c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:16:56.297393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:56.333253 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 640/1289] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:16:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:16:56.601942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9415f9e-0fc1-447e-93f4-e54d74905e29 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:56.700643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9415f9e-0fc1-447e-93f4-e54d74905e29 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:56.711404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:56.733688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba284787-b899-4961-8b6d-edea00630269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:56.734304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba284787-b899-4961-8b6d-edea00630269 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:56.734576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba284787-b899-4961-8b6d-edea00630269 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:56.734844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba284787-b899-4961-8b6d-edea00630269 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:56.735411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba284787-b899-4961-8b6d-edea00630269 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:56.736794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba284787-b899-4961-8b6d-edea00630269 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ba284787-b899-4961-8b6d-edea00630269 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:16:56.745451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:16:56.746661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:16:56.747727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 650/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Fri Sep 2 09:16:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:16:56.752450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0144e2-b753-4dd3-b712-bf56dda906c7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:56.850514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0144e2-b753-4dd3-b712-bf56dda906c7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:56.884249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fa6b0-7901-4ef6-9b43-2237170cfc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:56.884862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa6b0-7901-4ef6-9b43-2237170cfc41 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:56.885111 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa6b0-7901-4ef6-9b43-2237170cfc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:56.885381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa6b0-7901-4ef6-9b43-2237170cfc41 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:56.885997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fa6b0-7901-4ef6-9b43-2237170cfc41 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:56.886294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fa6b0-7901-4ef6-9b43-2237170cfc41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:56.887649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fa6b0-7901-4ef6-9b43-2237170cfc41 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:56.892609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 641/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Fri Sep 2 09:16:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:56.898496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba284787-b899-4961-8b6d-edea00630269 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:56.995664 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba284787-b899-4961-8b6d-edea00630269 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:57.028745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8cb96-648c-4bb2-b909-ab05150eb7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:57.029332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8cb96-648c-4bb2-b909-ab05150eb7dd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:57.029610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8cb96-648c-4bb2-b909-ab05150eb7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:57.029879 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8cb96-648c-4bb2-b909-ab05150eb7dd None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:57.030488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8cb96-648c-4bb2-b909-ab05150eb7dd None admin] RBAC: Adding query filter params (type=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:16:57.030785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8cb96-648c-4bb2-b909-ab05150eb7dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:57.032163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8cb96-648c-4bb2-b909-ab05150eb7dd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:57.036517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 651/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Fri Sep 2 09:16:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:16:58.902789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6707a1b-fe15-4026-8580-033301689196 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:58.903295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6707a1b-fe15-4026-8580-033301689196 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:58.903438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6707a1b-fe15-4026-8580-033301689196 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:58.904932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 642/1293] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:16:58.910563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c48f-215d-400c-808f-8c6b9a12abe6 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:58.910963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c48f-215d-400c-808f-8c6b9a12abe6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:58.911094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c48f-215d-400c-808f-8c6b9a12abe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:58.929554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6776c48f-215d-400c-808f-8c6b9a12abe6 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:16:58.930738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6776c48f-215d-400c-808f-8c6b9a12abe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:16:58.959246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:58.995267 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 652/1294] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:16:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:16:59.260990 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6707a1b-fe15-4026-8580-033301689196 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:16:59.293760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:59.363382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6707a1b-fe15-4026-8580-033301689196 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:16:59.397405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a4594-9229-4992-b2e3-e378eff5727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:16:59.398011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a4594-9229-4992-b2e3-e378eff5727c None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:16:59.398289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a4594-9229-4992-b2e3-e378eff5727c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:16:59.398560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a4594-9229-4992-b2e3-e378eff5727c None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:16:59.399215 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a4594-9229-4992-b2e3-e378eff5727c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:16:59.400643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a4594-9229-4992-b2e3-e378eff5727c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:16:59.498652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 643/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Fri Sep 2 09:16:59 2022] POST /identity/v3/services => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:17:01.459712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6a9d3-6349-4a6f-bd17-b9832a52b795 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:01.460290 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6a9d3-6349-4a6f-bd17-b9832a52b795 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:01.460290 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6a9d3-6349-4a6f-bd17-b9832a52b795 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:01.461655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 653/1296] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:17:01.466851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d95ad5-d4b2-4a9b-8068-7146d9a50091 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:01.467231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d95ad5-d4b2-4a9b-8068-7146d9a50091 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:01.467399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d95ad5-d4b2-4a9b-8068-7146d9a50091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:01.484908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c7d95ad5-d4b2-4a9b-8068-7146d9a50091 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:17:01.486078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c7d95ad5-d4b2-4a9b-8068-7146d9a50091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:17:01.556413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 644/1297] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:17:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:17:01.823865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6a9d3-6349-4a6f-bd17-b9832a52b795 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:17:01.923719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6a9d3-6349-4a6f-bd17-b9832a52b795 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:17:01.957358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccd41a-7678-4934-b419-23d61a402eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:17:01.957969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccd41a-7678-4934-b419-23d61a402eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:01.958245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccd41a-7678-4934-b419-23d61a402eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:01.958516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccd41a-7678-4934-b419-23d61a402eb9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:01.959081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccd41a-7678-4934-b419-23d61a402eb9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:17:01.960590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccd41a-7678-4934-b419-23d61a402eb9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-87ccd41a-7678-4934-b419-23d61a402eb9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:17:01.969395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:17:01.970542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:17:01.971621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 654/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Fri Sep 2 09:17:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:17:01.977008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d95ad5-d4b2-4a9b-8068-7146d9a50091 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:17:01.995426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:02.072294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d95ad5-d4b2-4a9b-8068-7146d9a50091 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:17:02.105104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11768c15-4769-4f51-9fc0-0854db317cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:17:02.105629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11768c15-4769-4f51-9fc0-0854db317cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:02.105906 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11768c15-4769-4f51-9fc0-0854db317cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:02.106168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11768c15-4769-4f51-9fc0-0854db317cc1 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:02.106782 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11768c15-4769-4f51-9fc0-0854db317cc1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:17:02.107078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11768c15-4769-4f51-9fc0-0854db317cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:17:02.108549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11768c15-4769-4f51-9fc0-0854db317cc1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:17:02.113472 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 645/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Fri Sep 2 09:17:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:17:02.119794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccd41a-7678-4934-b419-23d61a402eb9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:17:02.152111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:02.217477 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccd41a-7678-4934-b419-23d61a402eb9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:17:02.250615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ce2a4-98da-4c4f-9ec1-cc24b0338d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:17:02.251315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce2a4-98da-4c4f-9ec1-cc24b0338d06 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:02.251592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce2a4-98da-4c4f-9ec1-cc24b0338d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:02.251869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce2a4-98da-4c4f-9ec1-cc24b0338d06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:02.252584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ce2a4-98da-4c4f-9ec1-cc24b0338d06 None admin] RBAC: Adding query filter params (interface=public, service_id=5bf755ebe54e4c099e11fbc9faddd170, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:17:02.252889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ce2a4-98da-4c4f-9ec1-cc24b0338d06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:17:02.254272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ce2a4-98da-4c4f-9ec1-cc24b0338d06 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:17:02.259205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 655/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Fri Sep 2 09:17:02 2022] GET /identity/v3/endpoints?service_id=5bf755ebe54e4c099e11fbc9faddd170&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:17:02.265556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11768c15-4769-4f51-9fc0-0854db317cc1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:17:02.346501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:02.364729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11768c15-4769-4f51-9fc0-0854db317cc1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:17:02.398733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccf2d7-5631-4270-be87-d83106f4cfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:17:02.399332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf2d7-5631-4270-be87-d83106f4cfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:02.399607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf2d7-5631-4270-be87-d83106f4cfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:02.399904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf2d7-5631-4270-be87-d83106f4cfa0 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:02.400498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf2d7-5631-4270-be87-d83106f4cfa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:17:02.401858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf2d7-5631-4270-be87-d83106f4cfa0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:17:02.408726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 646/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Fri Sep 2 09:17:02 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:17:04.301623 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3250fe-9a9c-4f2c-bd82-cda074b892aa None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:04.302161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3250fe-9a9c-4f2c-bd82-cda074b892aa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:04.302161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3250fe-9a9c-4f2c-bd82-cda074b892aa None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:04.303529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 656/1302] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:17:04.308912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8b6e-6265-4c15-b3fc-656e951938be None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:04.309339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8b6e-6265-4c15-b3fc-656e951938be None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:04.309493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8b6e-6265-4c15-b3fc-656e951938be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:04.327930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-44bf8b6e-6265-4c15-b3fc-656e951938be None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:17:04.329108 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-44bf8b6e-6265-4c15-b3fc-656e951938be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:17:04.394335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 647/1303] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:17:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 09:17:04.663163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3250fe-9a9c-4f2c-bd82-cda074b892aa None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:17:04.755623 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:04.762306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3250fe-9a9c-4f2c-bd82-cda074b892aa None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:17:04.795132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98fe9e-f3c4-4646-a0fa-7517ff649a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:17:04.795752 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98fe9e-f3c4-4646-a0fa-7517ff649a40 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:04.796065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98fe9e-f3c4-4646-a0fa-7517ff649a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:04.796337 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98fe9e-f3c4-4646-a0fa-7517ff649a40 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:04.796904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98fe9e-f3c4-4646-a0fa-7517ff649a40 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:17:04.798260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98fe9e-f3c4-4646-a0fa-7517ff649a40 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ef98fe9e-f3c4-4646-a0fa-7517ff649a40 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 09:17:04.806899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 09:17:04.818018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Sep 02 09:17:04.818845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 657/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Fri Sep 2 09:17:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 09:17:04.819660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8b6e-6265-4c15-b3fc-656e951938be None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:17:04.889018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:04.911994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8b6e-6265-4c15-b3fc-656e951938be None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:17:04.946007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a25ca-6997-4d79-bf9a-145f301989b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:17:04.946553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a25ca-6997-4d79-bf9a-145f301989b0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:04.946832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a25ca-6997-4d79-bf9a-145f301989b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:04.947103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a25ca-6997-4d79-bf9a-145f301989b0 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:04.947727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a25ca-6997-4d79-bf9a-145f301989b0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:17:04.948068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a25ca-6997-4d79-bf9a-145f301989b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:17:04.949438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a25ca-6997-4d79-bf9a-145f301989b0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:17:04.954483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 648/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Fri Sep 2 09:17:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:17:04.961178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98fe9e-f3c4-4646-a0fa-7517ff649a40 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:17:05.058481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98fe9e-f3c4-4646-a0fa-7517ff649a40 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:17:05.090666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949b0c7-80c7-4d44-9aca-5b1db2e2a526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:17:05.091261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949b0c7-80c7-4d44-9aca-5b1db2e2a526 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:17:05.091536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949b0c7-80c7-4d44-9aca-5b1db2e2a526 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:17:05.091806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949b0c7-80c7-4d44-9aca-5b1db2e2a526 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:17:05.092493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949b0c7-80c7-4d44-9aca-5b1db2e2a526 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:17:05.093846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949b0c7-80c7-4d44-9aca-5b1db2e2a526 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:17:05.168451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 658/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:17:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:17:14.951440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=30 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:15.163921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:10.434269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3541-84ec-44c4-bae9-aad8dfe8a6e7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:10.434700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3541-84ec-44c4-bae9-aad8dfe8a6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:10.434952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3541-84ec-44c4-bae9-aad8dfe8a6e7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:10.442016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96439-3f91-4200-8055-e83d0556fd5a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:10.442422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96439-3f91-4200-8055-e83d0556fd5a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:10.442647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96439-3f91-4200-8055-e83d0556fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:10.446551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 649/1307] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:10.577936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-11f96439-3f91-4200-8055-e83d0556fd5a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:10.579166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-11f96439-3f91-4200-8055-e83d0556fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:10.752028 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 659/1308] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:23:11.046426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c94ab2-ca8b-4247-8e43-6a3e3ef90a86 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:11.046704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c94ab2-ca8b-4247-8e43-6a3e3ef90a86 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:11.047250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c94ab2-ca8b-4247-8e43-6a3e3ef90a86 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:11.048762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 650/1309] 10.222.0.55 () {54 vars in 965 bytes} [Fri Sep 2 09:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:11.055456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd2c52-20ac-472d-8625-b7cd879cea76 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:11.055782 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd2c52-20ac-472d-8625-b7cd879cea76 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:11.056071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd2c52-20ac-472d-8625-b7cd879cea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:11.144872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-76cd2c52-20ac-472d-8625-b7cd879cea76 None None] MFA Rules not processed for user `81bb83de9f794ac9b02e5dca2df3e4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:11.146101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-76cd2c52-20ac-472d-8625-b7cd879cea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:11.169308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:11.233997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 660/1310] 10.222.0.55 () {58 vars in 1062 bytes} [Fri Sep 2 09:23:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:11.244225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c94ab2-ca8b-4247-8e43-6a3e3ef90a86 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:11.246099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-46c94ab2-ca8b-4247-8e43-6a3e3ef90a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:11.360732 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c94ab2-ca8b-4247-8e43-6a3e3ef90a86 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:11.439570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b10173-b7ee-4017-af7b-7e3deda069fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:11.440232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b10173-b7ee-4017-af7b-7e3deda069fd service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:11.441127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b10173-b7ee-4017-af7b-7e3deda069fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:11.441254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b10173-b7ee-4017-af7b-7e3deda069fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:11.442877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-92b10173-b7ee-4017-af7b-7e3deda069fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:11.500237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:11.558645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b10173-b7ee-4017-af7b-7e3deda069fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:11.560160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b10173-b7ee-4017-af7b-7e3deda069fd service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:11.582589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 651/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:13.824775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2375b1-514f-435f-96b2-18def7354bd1 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:13.825268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2375b1-514f-435f-96b2-18def7354bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:13.825268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2375b1-514f-435f-96b2-18def7354bd1 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:13.826593 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 661/1312] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:13.832472 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0c287-9c92-4ebe-856e-a61aa133c653 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:13.832911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0c287-9c92-4ebe-856e-a61aa133c653 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:13.833081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0c287-9c92-4ebe-856e-a61aa133c653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:13.917600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-21c0c287-9c92-4ebe-856e-a61aa133c653 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:13.918734 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-21c0c287-9c92-4ebe-856e-a61aa133c653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:14.021860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 652/1313] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:14.310684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2375b1-514f-435f-96b2-18def7354bd1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:14.312323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ef2375b1-514f-435f-96b2-18def7354bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:14.414123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2375b1-514f-435f-96b2-18def7354bd1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:14.484442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:14.487076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421eb80-6b8b-4ca7-bd17-b7014bd87bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:14.487689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421eb80-6b8b-4ca7-bd17-b7014bd87bcc service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:14.488017 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421eb80-6b8b-4ca7-bd17-b7014bd87bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:14.488294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421eb80-6b8b-4ca7-bd17-b7014bd87bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:14.489906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7421eb80-6b8b-4ca7-bd17-b7014bd87bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:14.603161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421eb80-6b8b-4ca7-bd17-b7014bd87bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:14.604672 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421eb80-6b8b-4ca7-bd17-b7014bd87bcc service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:14.623345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 662/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:17.030110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbaadd-56ea-4a3c-92fe-3156cd779781 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:17.030641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbaadd-56ea-4a3c-92fe-3156cd779781 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:17.030641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbaadd-56ea-4a3c-92fe-3156cd779781 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:17.032025 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 653/1315] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:17.037867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5c7b2-b08c-4b46-ada0-fa1439d249f5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:17.038271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5c7b2-b08c-4b46-ada0-fa1439d249f5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:17.038413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5c7b2-b08c-4b46-ada0-fa1439d249f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:17.105078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-17b5c7b2-b08c-4b46-ada0-fa1439d249f5 None None] MFA Rules not processed for user `4fca947af30f472881e3a8db5471e1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:17.106340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-17b5c7b2-b08c-4b46-ada0-fa1439d249f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:17.158198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:17.202100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 663/1316] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:23:17.492826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbaadd-56ea-4a3c-92fe-3156cd779781 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:17.494340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b1bbaadd-56ea-4a3c-92fe-3156cd779781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:17.504725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:17.596557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbaadd-56ea-4a3c-92fe-3156cd779781 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:17.668614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f17764-5c10-49d0-baab-096525d35e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:17.669209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17764-5c10-49d0-baab-096525d35e73 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:17.669480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17764-5c10-49d0-baab-096525d35e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:17.669744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17764-5c10-49d0-baab-096525d35e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:17.671342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a9f17764-5c10-49d0-baab-096525d35e73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:17.732955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:17.779339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f17764-5c10-49d0-baab-096525d35e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:17.780796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f17764-5c10-49d0-baab-096525d35e73 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:17.798526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 654/1317] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:20.402291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f8113-dec4-47b7-8763-0929ab888f62 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:20.402853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f8113-dec4-47b7-8763-0929ab888f62 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:20.402853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f8113-dec4-47b7-8763-0929ab888f62 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:20.404218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 664/1318] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:20.409330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cfd84-d333-4465-a34e-f24c6a21e723 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:20.409736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cfd84-d333-4465-a34e-f24c6a21e723 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:20.409882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cfd84-d333-4465-a34e-f24c6a21e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:20.474084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-927cfd84-d333-4465-a34e-f24c6a21e723 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:20.475276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-927cfd84-d333-4465-a34e-f24c6a21e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:20.571678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 655/1319] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:20.852106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f8113-dec4-47b7-8763-0929ab888f62 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:20.853620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-300f8113-dec4-47b7-8763-0929ab888f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:20.953139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f8113-dec4-47b7-8763-0929ab888f62 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:21.023315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6cb71-5c4e-46d6-b50b-ceb75a0594a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:21.023923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6cb71-5c4e-46d6-b50b-ceb75a0594a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:21.024197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6cb71-5c4e-46d6-b50b-ceb75a0594a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:21.024461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6cb71-5c4e-46d6-b50b-ceb75a0594a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:21.026041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f8b6cb71-5c4e-46d6-b50b-ceb75a0594a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:21.033122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:21.131499 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6cb71-5c4e-46d6-b50b-ceb75a0594a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:21.132871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6cb71-5c4e-46d6-b50b-ceb75a0594a0 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:21.150503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 665/1320] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:24.001447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43826bc-9ab4-4f8a-ab2e-f08c91fcc2a5 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:24.002052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43826bc-9ab4-4f8a-ab2e-f08c91fcc2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:24.002052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43826bc-9ab4-4f8a-ab2e-f08c91fcc2a5 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:24.004057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 656/1321] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:24.009113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892a39e-88a6-48a3-9d5a-ee89f3757806 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:24.009581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892a39e-88a6-48a3-9d5a-ee89f3757806 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:24.009782 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892a39e-88a6-48a3-9d5a-ee89f3757806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:24.074635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8892a39e-88a6-48a3-9d5a-ee89f3757806 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:24.075829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8892a39e-88a6-48a3-9d5a-ee89f3757806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:24.133473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:24.171361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 666/1322] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:24.454342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43826bc-9ab4-4f8a-ab2e-f08c91fcc2a5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:24.455946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c43826bc-9ab4-4f8a-ab2e-f08c91fcc2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:24.475823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:24.564172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43826bc-9ab4-4f8a-ab2e-f08c91fcc2a5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:24.638880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d452a-01eb-43de-bd98-40f3814117a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:24.639485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d452a-01eb-43de-bd98-40f3814117a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:24.639759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d452a-01eb-43de-bd98-40f3814117a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:24.640059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d452a-01eb-43de-bd98-40f3814117a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:24.641640 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8a1d452a-01eb-43de-bd98-40f3814117a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:24.712381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:24.750646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d452a-01eb-43de-bd98-40f3814117a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:24.752277 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d452a-01eb-43de-bd98-40f3814117a1 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:24.770213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 657/1323] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:26.722968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8cf21-5bc1-4b10-a689-9aba99afbd58 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:26.723536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8cf21-5bc1-4b10-a689-9aba99afbd58 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:26.723536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8cf21-5bc1-4b10-a689-9aba99afbd58 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:26.724891 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 667/1324] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:26.730361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75bc45-bdc5-4239-9331-e33625c34ad2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:26.730841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75bc45-bdc5-4239-9331-e33625c34ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:26.731071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75bc45-bdc5-4239-9331-e33625c34ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:26.797582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-cf75bc45-bdc5-4239-9331-e33625c34ad2 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:26.798791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-cf75bc45-bdc5-4239-9331-e33625c34ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:26.896880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 658/1325] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:27.178393 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8cf21-5bc1-4b10-a689-9aba99afbd58 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:27.180157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a9a8cf21-5bc1-4b10-a689-9aba99afbd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:27.282190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8cf21-5bc1-4b10-a689-9aba99afbd58 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:27.357284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9f5f9-7e67-434e-91cb-dbfd9f4eed07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:27.357820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9f5f9-7e67-434e-91cb-dbfd9f4eed07 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:27.358096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9f5f9-7e67-434e-91cb-dbfd9f4eed07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:27.361427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9f5f9-7e67-434e-91cb-dbfd9f4eed07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:27.363163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-42e9f5f9-7e67-434e-91cb-dbfd9f4eed07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:27.381149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:27.471780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9f5f9-7e67-434e-91cb-dbfd9f4eed07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:27.473715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9f5f9-7e67-434e-91cb-dbfd9f4eed07 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:27.491136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 668/1326] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:29.459057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86615b9-7b1e-484d-8e16-2c7fce3f6813 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:29.459578 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86615b9-7b1e-484d-8e16-2c7fce3f6813 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:29.459578 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86615b9-7b1e-484d-8e16-2c7fce3f6813 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:29.460907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 659/1327] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:29.466347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b2a4a-ae91-44ec-9405-81f95d070fe7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:29.466875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b2a4a-ae91-44ec-9405-81f95d070fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:29.466875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b2a4a-ae91-44ec-9405-81f95d070fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:29.534318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-001b2a4a-ae91-44ec-9405-81f95d070fe7 None None] MFA Rules not processed for user `4fca947af30f472881e3a8db5471e1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:29.536044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-001b2a4a-ae91-44ec-9405-81f95d070fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:29.604532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:29.636121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 669/1328] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:29.919355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86615b9-7b1e-484d-8e16-2c7fce3f6813 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:29.920951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e86615b9-7b1e-484d-8e16-2c7fce3f6813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:29.961471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:30.040712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86615b9-7b1e-484d-8e16-2c7fce3f6813 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:30.115370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cd6e6-0a91-485f-847f-7c7cb7921423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:30.116011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd6e6-0a91-485f-847f-7c7cb7921423 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:30.116292 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd6e6-0a91-485f-847f-7c7cb7921423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:30.116565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd6e6-0a91-485f-847f-7c7cb7921423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:30.118442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b46cd6e6-0a91-485f-847f-7c7cb7921423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:30.196212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:30.227059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cd6e6-0a91-485f-847f-7c7cb7921423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:30.228876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cd6e6-0a91-485f-847f-7c7cb7921423 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:30.248096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 660/1329] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:32.599532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c3e3-03a8-40ba-8b5d-8e3ec3630e74 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:32.600112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c3e3-03a8-40ba-8b5d-8e3ec3630e74 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:32.600112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c3e3-03a8-40ba-8b5d-8e3ec3630e74 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:32.601461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 670/1330] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:32.606620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604591c-96aa-4d79-8321-19754731e1ff None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:32.607389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604591c-96aa-4d79-8321-19754731e1ff None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:32.607389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604591c-96aa-4d79-8321-19754731e1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:32.672293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-0604591c-96aa-4d79-8321-19754731e1ff None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:32.673488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0604591c-96aa-4d79-8321-19754731e1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:32.768224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 661/1331] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:33.053082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c3e3-03a8-40ba-8b5d-8e3ec3630e74 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:33.054623 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a9e7c3e3-03a8-40ba-8b5d-8e3ec3630e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:33.156397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c3e3-03a8-40ba-8b5d-8e3ec3630e74 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:33.233169 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e896aad-d822-4956-b2b8-9741bbb5aa21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:33.233867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e896aad-d822-4956-b2b8-9741bbb5aa21 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:33.234203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e896aad-d822-4956-b2b8-9741bbb5aa21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:33.234511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e896aad-d822-4956-b2b8-9741bbb5aa21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:33.236384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2e896aad-d822-4956-b2b8-9741bbb5aa21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:33.263734 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:33.344715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e896aad-d822-4956-b2b8-9741bbb5aa21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:33.346082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e896aad-d822-4956-b2b8-9741bbb5aa21 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:33.364607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 671/1332] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:35.299083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b884-0328-4f37-b48f-cf08b8e3f548 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:35.299617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b884-0328-4f37-b48f-cf08b8e3f548 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:35.299617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b884-0328-4f37-b48f-cf08b8e3f548 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:35.301624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 662/1333] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:35.306670 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7cf1-f8cf-4db7-9eb5-655dfeb4b878 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:35.307079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7cf1-f8cf-4db7-9eb5-655dfeb4b878 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:35.307216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7cf1-f8cf-4db7-9eb5-655dfeb4b878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:35.371372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-61cf7cf1-f8cf-4db7-9eb5-655dfeb4b878 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:35.372582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-61cf7cf1-f8cf-4db7-9eb5-655dfeb4b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:35.444945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:35.466850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 672/1334] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:35.764036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd3dd-e5a1-4d7d-9510-1435f552dd54 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:35.764348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd3dd-e5a1-4d7d-9510-1435f552dd54 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:35.764626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd3dd-e5a1-4d7d-9510-1435f552dd54 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:35.766008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 663/1335] 10.222.0.55 () {54 vars in 965 bytes} [Fri Sep 2 09:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:35.772224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571f55d-8c07-4f51-8b52-297ac3a76d6d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:35.772579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571f55d-8c07-4f51-8b52-297ac3a76d6d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:35.772854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571f55d-8c07-4f51-8b52-297ac3a76d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:35.848872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9571f55d-8c07-4f51-8b52-297ac3a76d6d None None] MFA Rules not processed for user `81bb83de9f794ac9b02e5dca2df3e4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:35.850324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9571f55d-8c07-4f51-8b52-297ac3a76d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:35.923147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 673/1336] 10.222.0.55 () {58 vars in 1062 bytes} [Fri Sep 2 09:23:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:35.932195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd3dd-e5a1-4d7d-9510-1435f552dd54 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:35.933684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-280cd3dd-e5a1-4d7d-9510-1435f552dd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:35.973940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:36.035806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd3dd-e5a1-4d7d-9510-1435f552dd54 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:36.106299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4295d9-2d82-4735-a970-04eb1b78e402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:36.106895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4295d9-2d82-4735-a970-04eb1b78e402 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:36.107168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4295d9-2d82-4735-a970-04eb1b78e402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:36.107436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4295d9-2d82-4735-a970-04eb1b78e402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:36.109022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2c4295d9-2d82-4735-a970-04eb1b78e402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:36.189098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:36.214223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4295d9-2d82-4735-a970-04eb1b78e402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:36.215642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4295d9-2d82-4735-a970-04eb1b78e402 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:36.233490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 664/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:39.226960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8a1da-9ec7-45e6-8a22-9dd7666c9158 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:39.227529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8a1da-9ec7-45e6-8a22-9dd7666c9158 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:39.227529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8a1da-9ec7-45e6-8a22-9dd7666c9158 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:39.228826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 674/1338] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:39.233887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc8b9f-5915-4bd2-9cd6-2e937ab1bc0b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:39.234307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc8b9f-5915-4bd2-9cd6-2e937ab1bc0b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:39.234423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc8b9f-5915-4bd2-9cd6-2e937ab1bc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:39.300882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-21cc8b9f-5915-4bd2-9cd6-2e937ab1bc0b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:39.302089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-21cc8b9f-5915-4bd2-9cd6-2e937ab1bc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:39.396526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 665/1339] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:39.679571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8a1da-9ec7-45e6-8a22-9dd7666c9158 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:39.681145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fce8a1da-9ec7-45e6-8a22-9dd7666c9158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:39.756142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:39.783133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8a1da-9ec7-45e6-8a22-9dd7666c9158 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:39.857113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5638682-0b39-4ba0-abe1-b2e946e5fb2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:39.857721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638682-0b39-4ba0-abe1-b2e946e5fb2f service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:39.857999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638682-0b39-4ba0-abe1-b2e946e5fb2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:39.858271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638682-0b39-4ba0-abe1-b2e946e5fb2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:39.859865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c5638682-0b39-4ba0-abe1-b2e946e5fb2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:39.967873 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5638682-0b39-4ba0-abe1-b2e946e5fb2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:39.969335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5638682-0b39-4ba0-abe1-b2e946e5fb2f service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:39.987899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 675/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:44.146094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a460-d97f-44e2-88c4-39faaad2343b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:44.146633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a460-d97f-44e2-88c4-39faaad2343b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:44.146633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a460-d97f-44e2-88c4-39faaad2343b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:44.147983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 666/1341] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:44.153090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae49e4-0f0d-4f9f-935b-4606e9b16755 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:44.153484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae49e4-0f0d-4f9f-935b-4606e9b16755 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:44.153629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae49e4-0f0d-4f9f-935b-4606e9b16755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:44.159007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:44.221615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-84ae49e4-0f0d-4f9f-935b-4606e9b16755 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:44.222888 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-84ae49e4-0f0d-4f9f-935b-4606e9b16755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:44.320183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 676/1342] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:44.601393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a460-d97f-44e2-88c4-39faaad2343b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:44.603022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4595a460-d97f-44e2-88c4-39faaad2343b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:44.654435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:44.711709 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a460-d97f-44e2-88c4-39faaad2343b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:44.784912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ce85c-3539-43c7-be67-abf227b097e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:44.785522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ce85c-3539-43c7-be67-abf227b097e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:44.785797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ce85c-3539-43c7-be67-abf227b097e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:44.786062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ce85c-3539-43c7-be67-abf227b097e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:44.787677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1c4ce85c-3539-43c7-be67-abf227b097e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:44.884810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:44.900738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ce85c-3539-43c7-be67-abf227b097e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:44.902187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ce85c-3539-43c7-be67-abf227b097e1 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:44.921063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 667/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:47.782967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be5ab-3be5-4c33-83b7-6dccdfc73221 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:47.783524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be5ab-3be5-4c33-83b7-6dccdfc73221 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:47.783524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be5ab-3be5-4c33-83b7-6dccdfc73221 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:47.785544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 677/1344] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:47.794059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d4b2e-e9d1-40a3-aa05-1d50c80d808c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:47.794059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d4b2e-e9d1-40a3-aa05-1d50c80d808c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:47.794059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d4b2e-e9d1-40a3-aa05-1d50c80d808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:47.858485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-993d4b2e-e9d1-40a3-aa05-1d50c80d808c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:47.859681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-993d4b2e-e9d1-40a3-aa05-1d50c80d808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:47.957834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 668/1345] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:48.239835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5be5ab-3be5-4c33-83b7-6dccdfc73221 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:48.241418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9f5be5ab-3be5-4c33-83b7-6dccdfc73221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:48.327297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:48.344338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5be5ab-3be5-4c33-83b7-6dccdfc73221 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:48.421221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22179c7-452f-4d5a-a982-2d81ec2ba8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:48.421827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22179c7-452f-4d5a-a982-2d81ec2ba8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:48.422103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22179c7-452f-4d5a-a982-2d81ec2ba8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:48.422371 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22179c7-452f-4d5a-a982-2d81ec2ba8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:48.423993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e22179c7-452f-4d5a-a982-2d81ec2ba8b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:48.538044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22179c7-452f-4d5a-a982-2d81ec2ba8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:48.539491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22179c7-452f-4d5a-a982-2d81ec2ba8b1 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:48.557963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 678/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:52.894086 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf7ea7-05bf-4fab-b6a6-4eb4c5fbc9ff None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:52.894640 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf7ea7-05bf-4fab-b6a6-4eb4c5fbc9ff None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:52.894775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf7ea7-05bf-4fab-b6a6-4eb4c5fbc9ff None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:52.896266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 669/1347] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:52.901688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d773c-8954-4389-ad7c-e1a73195b167 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:52.902149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d773c-8954-4389-ad7c-e1a73195b167 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:52.902244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d773c-8954-4389-ad7c-e1a73195b167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:52.918177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:52.972304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-cd8d773c-8954-4389-ad7c-e1a73195b167 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:52.973529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cd8d773c-8954-4389-ad7c-e1a73195b167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:53.076726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 679/1348] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:23:53.366200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf7ea7-05bf-4fab-b6a6-4eb4c5fbc9ff None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:23:53.367738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6fbf7ea7-05bf-4fab-b6a6-4eb4c5fbc9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:53.424572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:53.468742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf7ea7-05bf-4fab-b6a6-4eb4c5fbc9ff None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:23:53.540237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9621b93-4644-4c60-bed6-53aa76a0aa15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:23:53.540823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621b93-4644-4c60-bed6-53aa76a0aa15 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:53.541095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621b93-4644-4c60-bed6-53aa76a0aa15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:53.541361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621b93-4644-4c60-bed6-53aa76a0aa15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:53.542920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a9621b93-4644-4c60-bed6-53aa76a0aa15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:53.645919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:53.649307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9621b93-4644-4c60-bed6-53aa76a0aa15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:23:53.650795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9621b93-4644-4c60-bed6-53aa76a0aa15 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:23:53.669485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 670/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:23:58.533151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ca908-8d82-4ce7-84f1-723b82295be8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:58.533151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ca908-8d82-4ce7-84f1-723b82295be8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:58.533151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ca908-8d82-4ce7-84f1-723b82295be8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:58.537082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 680/1350] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:23:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:23:58.543538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a587d6-3319-438f-99e4-1f61b75dc52b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:23:58.544405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a587d6-3319-438f-99e4-1f61b75dc52b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:23:58.544888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a587d6-3319-438f-99e4-1f61b75dc52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:23:58.685002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a4a587d6-3319-438f-99e4-1f61b75dc52b None None] MFA Rules not processed for user `d1d19d1439914eac9993bf31fa4c9384`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:23:58.686239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a4a587d6-3319-438f-99e4-1f61b75dc52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:23:58.814286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 671/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:02.934178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71068731-03cc-43a3-9ff5-86eb84950542 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:02.934700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71068731-03cc-43a3-9ff5-86eb84950542 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:02.934700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71068731-03cc-43a3-9ff5-86eb84950542 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:02.936256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 681/1352] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:02.941155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114170ef-411d-4ec8-9169-808dd4d4e317 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:02.941959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114170ef-411d-4ec8-9169-808dd4d4e317 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:02.942429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114170ef-411d-4ec8-9169-808dd4d4e317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:03.000169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:03.024042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-114170ef-411d-4ec8-9169-808dd4d4e317 None None] MFA Rules not processed for user `d1d19d1439914eac9993bf31fa4c9384`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:03.025246 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-114170ef-411d-4ec8-9169-808dd4d4e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:03.074675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=59 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:03.138876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 672/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:04.507626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb71b4-5226-4046-a847-22eaf0df4e78 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:04.508210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb71b4-5226-4046-a847-22eaf0df4e78 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:04.508210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb71b4-5226-4046-a847-22eaf0df4e78 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:04.509541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 682/1354] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:04.514629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e6443-6ad8-485b-8b58-e206a4bc86b7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:04.517853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e6443-6ad8-485b-8b58-e206a4bc86b7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:04.517853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e6443-6ad8-485b-8b58-e206a4bc86b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:04.592640 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-587e6443-6ad8-485b-8b58-e206a4bc86b7 None None] MFA Rules not processed for user `d1d19d1439914eac9993bf31fa4c9384`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:04.593824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-587e6443-6ad8-485b-8b58-e206a4bc86b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:04.637860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:04.703834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 673/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:24:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:24:08.005808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448cf1-2fba-4c6d-85c2-3cb418f9d360 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:08.006303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448cf1-2fba-4c6d-85c2-3cb418f9d360 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:08.006399 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448cf1-2fba-4c6d-85c2-3cb418f9d360 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:08.007713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 683/1356] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:08.017137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f21a-82fe-4911-9246-70acb66cf593 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:08.017599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f21a-82fe-4911-9246-70acb66cf593 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:08.017710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f21a-82fe-4911-9246-70acb66cf593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:08.105944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f5a9f21a-82fe-4911-9246-70acb66cf593 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:08.108110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f5a9f21a-82fe-4911-9246-70acb66cf593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:08.224963 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 674/1357] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:08.528140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e10a3b-1e38-4402-b56f-4d8aeb643764 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:08.528934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e10a3b-1e38-4402-b56f-4d8aeb643764 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:08.529755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e10a3b-1e38-4402-b56f-4d8aeb643764 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:08.532197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 684/1358] 10.222.0.55 () {54 vars in 962 bytes} [Fri Sep 2 09:24:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:08.538970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9308-cbc6-46d7-ac7a-b821c4e3eb16 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:08.540144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9308-cbc6-46d7-ac7a-b821c4e3eb16 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:08.540627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9308-cbc6-46d7-ac7a-b821c4e3eb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:08.559515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:08.619908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-087f9308-cbc6-46d7-ac7a-b821c4e3eb16 None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:08.621246 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-087f9308-cbc6-46d7-ac7a-b821c4e3eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:08.740931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 675/1359] 10.222.0.55 () {58 vars in 1059 bytes} [Fri Sep 2 09:24:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:24:08.759069 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e10a3b-1e38-4402-b56f-4d8aeb643764 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:08.760763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-28e10a3b-1e38-4402-b56f-4d8aeb643764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:08.924352 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e10a3b-1e38-4402-b56f-4d8aeb643764 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:09.000651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:09.045764 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260311f-7f1b-4773-90ea-535405bb7ba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:09.046490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260311f-7f1b-4773-90ea-535405bb7ba0 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:09.046863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260311f-7f1b-4773-90ea-535405bb7ba0 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:09.047230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260311f-7f1b-4773-90ea-535405bb7ba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:09.048936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2260311f-7f1b-4773-90ea-535405bb7ba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:09.140652 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260311f-7f1b-4773-90ea-535405bb7ba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:09.142406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260311f-7f1b-4773-90ea-535405bb7ba0 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:09.161595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 685/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:11.272157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1fc0d-0e3e-42d3-b867-c909b97dc16d None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:11.272680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1fc0d-0e3e-42d3-b867-c909b97dc16d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:11.272680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1fc0d-0e3e-42d3-b867-c909b97dc16d None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:11.274175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 676/1361] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:11.279243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d5899-41fb-4d5c-ade4-8700e75f891e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:11.279641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d5899-41fb-4d5c-ade4-8700e75f891e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:11.279783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d5899-41fb-4d5c-ade4-8700e75f891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:11.347902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-344d5899-41fb-4d5c-ade4-8700e75f891e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:11.349083 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-344d5899-41fb-4d5c-ade4-8700e75f891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:11.387651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:11.453243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 686/1362] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:24:11.755749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1fc0d-0e3e-42d3-b867-c909b97dc16d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:11.755749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3ea1fc0d-0e3e-42d3-b867-c909b97dc16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:11.820753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:11.917839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1fc0d-0e3e-42d3-b867-c909b97dc16d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:12.039773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5fda0-4556-4a87-8eec-23a92f7ec51c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:12.040411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5fda0-4556-4a87-8eec-23a92f7ec51c service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:12.040697 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5fda0-4556-4a87-8eec-23a92f7ec51c service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:12.040966 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5fda0-4556-4a87-8eec-23a92f7ec51c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:12.042570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d7f5fda0-4556-4a87-8eec-23a92f7ec51c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:12.074223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:12.160907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5fda0-4556-4a87-8eec-23a92f7ec51c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:12.162684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5fda0-4556-4a87-8eec-23a92f7ec51c service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:12.184981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 677/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:14.539755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa808-6960-4c70-bf8c-033a0b509deb None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:14.540361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa808-6960-4c70-bf8c-033a0b509deb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:14.540656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa808-6960-4c70-bf8c-033a0b509deb None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:14.542086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 687/1364] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:14.547521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbf88e-afe3-4f5e-a5a3-4a1662648207 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:14.547965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbf88e-afe3-4f5e-a5a3-4a1662648207 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:14.548168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbf88e-afe3-4f5e-a5a3-4a1662648207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:14.619074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-badbf88e-afe3-4f5e-a5a3-4a1662648207 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:14.620581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-badbf88e-afe3-4f5e-a5a3-4a1662648207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:14.730783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:14.733847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 678/1365] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:15.055590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e34132-e585-4301-8276-6341363ceeda None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:15.055875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e34132-e585-4301-8276-6341363ceeda None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:15.056176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e34132-e585-4301-8276-6341363ceeda None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:15.057664 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 688/1366] 10.222.0.55 () {54 vars in 962 bytes} [Fri Sep 2 09:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:15.063407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6d34d-e6cd-46f8-a40c-c520b4b9d652 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:15.063914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6d34d-e6cd-46f8-a40c-c520b4b9d652 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:15.064335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6d34d-e6cd-46f8-a40c-c520b4b9d652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:15.175830 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-efa6d34d-e6cd-46f8-a40c-c520b4b9d652 None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:15.177063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-efa6d34d-e6cd-46f8-a40c-c520b4b9d652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:15.303364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 679/1367] 10.222.0.55 () {58 vars in 1059 bytes} [Fri Sep 2 09:24:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:15.311493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e34132-e585-4301-8276-6341363ceeda None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:15.313131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-42e34132-e585-4301-8276-6341363ceeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:15.467771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e34132-e585-4301-8276-6341363ceeda None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:15.488418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:15.583794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b90fb0-08ba-4783-bf6b-e822a341dc4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:15.585258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b90fb0-08ba-4783-bf6b-e822a341dc4a service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:15.585740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b90fb0-08ba-4783-bf6b-e822a341dc4a service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:15.586219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b90fb0-08ba-4783-bf6b-e822a341dc4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:15.588102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-92b90fb0-08ba-4783-bf6b-e822a341dc4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:15.685952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b90fb0-08ba-4783-bf6b-e822a341dc4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:15.687564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b90fb0-08ba-4783-bf6b-e822a341dc4a service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:15.706697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 689/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:16.207130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e8df5-ab5f-4dd7-8671-83572668de04 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:16.207683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e8df5-ab5f-4dd7-8671-83572668de04 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:16.207683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e8df5-ab5f-4dd7-8671-83572668de04 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:16.209239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 680/1369] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:16.214299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed2dfb-cb7e-4377-b2ca-e6a89db6811c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:16.214603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed2dfb-cb7e-4377-b2ca-e6a89db6811c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:16.214867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed2dfb-cb7e-4377-b2ca-e6a89db6811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:16.248303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:16.285222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c0ed2dfb-cb7e-4377-b2ca-e6a89db6811c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:16.286549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c0ed2dfb-cb7e-4377-b2ca-e6a89db6811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:16.388422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 690/1370] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:16.970217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91afc-96cf-46f3-b17f-9265b1c1caf8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:16.970217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91afc-96cf-46f3-b17f-9265b1c1caf8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:16.970217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91afc-96cf-46f3-b17f-9265b1c1caf8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:16.970217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 681/1371] 10.222.0.55 () {54 vars in 964 bytes} [Fri Sep 2 09:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:16.976119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3bbca-435e-4738-9579-fb17ea69151d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:16.976605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3bbca-435e-4738-9579-fb17ea69151d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:16.976784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3bbca-435e-4738-9579-fb17ea69151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:17.059929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-61e3bbca-435e-4738-9579-fb17ea69151d None None] MFA Rules not processed for user `81b6abdeca334777b597215dfe157688`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:17.061508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-61e3bbca-435e-4738-9579-fb17ea69151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:17.110425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:17.142299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 691/1372] 10.222.0.55 () {58 vars in 1061 bytes} [Fri Sep 2 09:24:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:17.150079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa91afc-96cf-46f3-b17f-9265b1c1caf8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:17.151760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7fa91afc-96cf-46f3-b17f-9265b1c1caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:17.204095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:17.260834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa91afc-96cf-46f3-b17f-9265b1c1caf8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:17.337953 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1ddda-014e-4c45-a00e-89be89a796fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:17.338563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1ddda-014e-4c45-a00e-89be89a796fc service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:17.338839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1ddda-014e-4c45-a00e-89be89a796fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:17.339110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1ddda-014e-4c45-a00e-89be89a796fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:17.340907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bcf1ddda-014e-4c45-a00e-89be89a796fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:17.448615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:17.462283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1ddda-014e-4c45-a00e-89be89a796fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:17.463740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1ddda-014e-4c45-a00e-89be89a796fc service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:17.482618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 682/1373] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:17.839382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026932b-0bf4-475a-9481-6208ed2ee3e3 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:17.839666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026932b-0bf4-475a-9481-6208ed2ee3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:17.840144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026932b-0bf4-475a-9481-6208ed2ee3e3 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:17.847060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d641f-1a8f-4675-8b2c-ba051164d3c5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:17.847923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 692/1374] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:17.848356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d641f-1a8f-4675-8b2c-ba051164d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:17.848637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d641f-1a8f-4675-8b2c-ba051164d3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:17.916110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8f9d641f-1a8f-4675-8b2c-ba051164d3c5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:17.917228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8f9d641f-1a8f-4675-8b2c-ba051164d3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:18.013582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 683/1375] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:18.301533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026932b-0bf4-475a-9481-6208ed2ee3e3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:18.303177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c026932b-0bf4-475a-9481-6208ed2ee3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:18.447601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026932b-0bf4-475a-9481-6208ed2ee3e3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:18.498551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:18.560566 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9bf4e-bfbc-4af8-987e-566534ed9bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:18.561186 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9bf4e-bfbc-4af8-987e-566534ed9bfa service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:18.561499 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9bf4e-bfbc-4af8-987e-566534ed9bfa service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:18.561806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9bf4e-bfbc-4af8-987e-566534ed9bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:18.563450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-13e9bf4e-bfbc-4af8-987e-566534ed9bfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:18.652597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9bf4e-bfbc-4af8-987e-566534ed9bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:18.654216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9bf4e-bfbc-4af8-987e-566534ed9bfa service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:18.672443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 693/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:20.741876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71f70d-bf48-44a8-9c01-be30da4b960f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:20.742385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71f70d-bf48-44a8-9c01-be30da4b960f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:20.742385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71f70d-bf48-44a8-9c01-be30da4b960f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:20.743741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 684/1377] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:20.749401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7563145-4ce5-4fb1-8a73-f4f319f1c51c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:20.749800 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7563145-4ce5-4fb1-8a73-f4f319f1c51c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:20.749955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7563145-4ce5-4fb1-8a73-f4f319f1c51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:20.817021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e7563145-4ce5-4fb1-8a73-f4f319f1c51c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:20.818217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e7563145-4ce5-4fb1-8a73-f4f319f1c51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:20.826677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:20.920100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 694/1378] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:21.223827 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71f70d-bf48-44a8-9c01-be30da4b960f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:21.224594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4b71f70d-bf48-44a8-9c01-be30da4b960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:21.295232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:21.385248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71f70d-bf48-44a8-9c01-be30da4b960f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:21.504419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfdd2c-9435-4eba-93ca-3f9d2147f161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:21.505049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfdd2c-9435-4eba-93ca-3f9d2147f161 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:21.505312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfdd2c-9435-4eba-93ca-3f9d2147f161 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:21.505581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfdd2c-9435-4eba-93ca-3f9d2147f161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:21.507164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-64bfdd2c-9435-4eba-93ca-3f9d2147f161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:21.526949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:21.600198 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfdd2c-9435-4eba-93ca-3f9d2147f161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:21.601813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfdd2c-9435-4eba-93ca-3f9d2147f161 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:21.621067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 685/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:23.667118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8fe8-8dc7-4039-a809-cd116edc2c76 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:23.667626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8fe8-8dc7-4039-a809-cd116edc2c76 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:23.667626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8fe8-8dc7-4039-a809-cd116edc2c76 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:23.668996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 695/1380] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:23.674556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1779d-0160-4d1f-8f08-279510416ac7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:23.674991 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1779d-0160-4d1f-8f08-279510416ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:23.675172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1779d-0160-4d1f-8f08-279510416ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:23.746629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-28c1779d-0160-4d1f-8f08-279510416ac7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:23.747860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-28c1779d-0160-4d1f-8f08-279510416ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:23.845893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:23.853219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 686/1381] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:24.141673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f8fe8-8dc7-4039-a809-cd116edc2c76 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:24.143359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-868f8fe8-8dc7-4039-a809-cd116edc2c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:24.292279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:24.302850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f8fe8-8dc7-4039-a809-cd116edc2c76 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:24.435443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e584b-337c-4938-a8c7-94b408e65725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:24.451742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e584b-337c-4938-a8c7-94b408e65725 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:24.451742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e584b-337c-4938-a8c7-94b408e65725 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:24.451742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e584b-337c-4938-a8c7-94b408e65725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:24.451742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b25e584b-337c-4938-a8c7-94b408e65725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:24.532899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e584b-337c-4938-a8c7-94b408e65725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:24.534500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e584b-337c-4938-a8c7-94b408e65725 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:24.592578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:24.592578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 696/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:26.876123 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd58224-efe0-47fe-b957-31f2185d8551 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:26.876704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd58224-efe0-47fe-b957-31f2185d8551 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:26.876704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd58224-efe0-47fe-b957-31f2185d8551 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:26.878034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 687/1383] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:24:26.883912 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c58e-26b7-4b8b-aec7-140a60e202bf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:26.884362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c58e-26b7-4b8b-aec7-140a60e202bf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:26.884628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c58e-26b7-4b8b-aec7-140a60e202bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:26.958450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2038c58e-26b7-4b8b-aec7-140a60e202bf None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:26.960179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2038c58e-26b7-4b8b-aec7-140a60e202bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:27.070970 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 697/1384] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:27.362579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd58224-efe0-47fe-b957-31f2185d8551 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:27.364714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0cd58224-efe0-47fe-b957-31f2185d8551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:27.514870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd58224-efe0-47fe-b957-31f2185d8551 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:27.584211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:27.630487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3560d5-fcb9-413a-a3d3-d246f4e13edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:27.630972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3560d5-fcb9-413a-a3d3-d246f4e13edf service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:27.631258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3560d5-fcb9-413a-a3d3-d246f4e13edf service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:27.631534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3560d5-fcb9-413a-a3d3-d246f4e13edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:27.633266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5d3560d5-fcb9-413a-a3d3-d246f4e13edf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:27.721582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3560d5-fcb9-413a-a3d3-d246f4e13edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:27.723795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3560d5-fcb9-413a-a3d3-d246f4e13edf service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:27.741778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 688/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:29.662659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26586fe-ee83-4c72-bc0c-b3e1a8f2769a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:29.663233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26586fe-ee83-4c72-bc0c-b3e1a8f2769a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:29.663233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26586fe-ee83-4c72-bc0c-b3e1a8f2769a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:29.664602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 698/1386] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:29.670080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed8a66-0f7f-4c3f-8027-9e05ba465311 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:29.670526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed8a66-0f7f-4c3f-8027-9e05ba465311 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:29.670642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed8a66-0f7f-4c3f-8027-9e05ba465311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:29.737039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-76ed8a66-0f7f-4c3f-8027-9e05ba465311 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:29.738347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-76ed8a66-0f7f-4c3f-8027-9e05ba465311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:29.771598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:29.841788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 689/1387] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:30.133080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26586fe-ee83-4c72-bc0c-b3e1a8f2769a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:30.135073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c26586fe-ee83-4c72-bc0c-b3e1a8f2769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:30.221667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:30.301550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26586fe-ee83-4c72-bc0c-b3e1a8f2769a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:30.415849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8e410-0fe5-407a-8ee1-31e9c93caa5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:30.416485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8e410-0fe5-407a-8ee1-31e9c93caa5e service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:30.416764 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8e410-0fe5-407a-8ee1-31e9c93caa5e service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:30.417037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8e410-0fe5-407a-8ee1-31e9c93caa5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:30.418640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8fb8e410-0fe5-407a-8ee1-31e9c93caa5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:30.458570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:30.520357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8e410-0fe5-407a-8ee1-31e9c93caa5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:30.521970 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8e410-0fe5-407a-8ee1-31e9c93caa5e service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:30.540802 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 699/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:32.616038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef9954-f252-4757-a0ef-a6c9e67925cd None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:32.616641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef9954-f252-4757-a0ef-a6c9e67925cd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:32.616641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef9954-f252-4757-a0ef-a6c9e67925cd None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:32.618081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 690/1389] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:32.623427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f202744-9859-4aae-b5b7-2ad092a6f018 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:32.623915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f202744-9859-4aae-b5b7-2ad092a6f018 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:32.624034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f202744-9859-4aae-b5b7-2ad092a6f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:32.690190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4f202744-9859-4aae-b5b7-2ad092a6f018 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:32.691876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4f202744-9859-4aae-b5b7-2ad092a6f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:32.786996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 700/1390] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:32.807218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f45e-c552-44e8-860e-45a7e755df5d None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:32.807584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f45e-c552-44e8-860e-45a7e755df5d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:32.807963 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f45e-c552-44e8-860e-45a7e755df5d None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:32.809395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 691/1391] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:32.814525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f59ba7-5168-4eb2-bb48-840ee0644bf3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:32.814812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f59ba7-5168-4eb2-bb48-840ee0644bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:32.815091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f59ba7-5168-4eb2-bb48-840ee0644bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:32.831626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:32.883098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-26f59ba7-5168-4eb2-bb48-840ee0644bf3 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:32.884260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-26f59ba7-5168-4eb2-bb48-840ee0644bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:32.981414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 701/1392] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:33.079714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688f45e-c552-44e8-860e-45a7e755df5d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:33.081286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4688f45e-c552-44e8-860e-45a7e755df5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:33.227830 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688f45e-c552-44e8-860e-45a7e755df5d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:33.244672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:33.280066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c923-f5a4-4abf-9c49-a70adfcb8c9e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:33.280356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c923-f5a4-4abf-9c49-a70adfcb8c9e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:33.280632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c923-f5a4-4abf-9c49-a70adfcb8c9e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:33.282009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 702/1393] 10.222.0.55 () {54 vars in 961 bytes} [Fri Sep 2 09:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:24:33.287545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f801b3-f373-463f-8455-d84be5219eee None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:33.287826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f801b3-f373-463f-8455-d84be5219eee None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:33.288143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f801b3-f373-463f-8455-d84be5219eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:33.346652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010794f6-5e73-42f2-a110-d4e2198d0cb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:33.347254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010794f6-5e73-42f2-a110-d4e2198d0cb4 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:33.348048 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010794f6-5e73-42f2-a110-d4e2198d0cb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:33.348311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010794f6-5e73-42f2-a110-d4e2198d0cb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:33.349902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-010794f6-5e73-42f2-a110-d4e2198d0cb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:33.364092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c4f801b3-f373-463f-8455-d84be5219eee None None] MFA Rules not processed for user `2a6267b159204df7af8a4f84d227f88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:33.365337 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c4f801b3-f373-463f-8455-d84be5219eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:33.400434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:33.440827 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010794f6-5e73-42f2-a110-d4e2198d0cb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:33.442488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010794f6-5e73-42f2-a110-d4e2198d0cb4 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:33.443261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 703/1394] 10.222.0.55 () {58 vars in 1058 bytes} [Fri Sep 2 09:24:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:24:33.450780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f801b3-f373-463f-8455-d84be5219eee None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:33.458212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f801b3-f373-463f-8455-d84be5219eee None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:33.461227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 692/1395] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:33.531669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb8c6c-7dba-4b92-98a8-d1f0fa1c9c4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6267b159204df7af8a4f84d227f88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:33.532294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8c6c-7dba-4b92-98a8-d1f0fa1c9c4a service glance] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:33.532567 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8c6c-7dba-4b92-98a8-d1f0fa1c9c4a service glance] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:33.532867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8c6c-7dba-4b92-98a8-d1f0fa1c9c4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:33.534450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9ccb8c6c-7dba-4b92-98a8-d1f0fa1c9c4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:33.641999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:33.646151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb8c6c-7dba-4b92-98a8-d1f0fa1c9c4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:33.647568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb8c6c-7dba-4b92-98a8-d1f0fa1c9c4a service glance] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:33.666436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 704/1396] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:24:34.549748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2308a32-182a-448c-aafd-6c62a13827db None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:34.550223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2308a32-182a-448c-aafd-6c62a13827db None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:34.550328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2308a32-182a-448c-aafd-6c62a13827db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:34.576467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:34.618041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b2308a32-182a-448c-aafd-6c62a13827db None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:34.619274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b2308a32-182a-448c-aafd-6c62a13827db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:34.710455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 693/1397] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:34.756281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f10b70-73f4-47d1-b2ca-dbd26b8b95e0 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:34.756827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f10b70-73f4-47d1-b2ca-dbd26b8b95e0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:34.756827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f10b70-73f4-47d1-b2ca-dbd26b8b95e0 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:34.758174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 705/1398] 10.222.0.55 () {54 vars in 943 bytes} [Fri Sep 2 09:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:34.764541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de208690-d912-4c91-8d6f-a14d13b1ee30 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:34.764831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de208690-d912-4c91-8d6f-a14d13b1ee30 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:34.765109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de208690-d912-4c91-8d6f-a14d13b1ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:34.841880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-de208690-d912-4c91-8d6f-a14d13b1ee30 None None] MFA Rules not processed for user `01367d6c12014bc0bc9410b4a5a98693`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:34.843100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-de208690-d912-4c91-8d6f-a14d13b1ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:34.895772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:34.956399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 694/1399] 10.222.0.55 () {58 vars in 1040 bytes} [Fri Sep 2 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:34.966374 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f10b70-73f4-47d1-b2ca-dbd26b8b95e0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:34.967997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-32f10b70-73f4-47d1-b2ca-dbd26b8b95e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:35.100313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f10b70-73f4-47d1-b2ca-dbd26b8b95e0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:35.169759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:35.203376 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da97e2-bc7a-4b21-a521-4455090300dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:35.204006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da97e2-bc7a-4b21-a521-4455090300dc service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:35.204285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da97e2-bc7a-4b21-a521-4455090300dc service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:35.204555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da97e2-bc7a-4b21-a521-4455090300dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:35.206176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-80da97e2-bc7a-4b21-a521-4455090300dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:35.287977 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da97e2-bc7a-4b21-a521-4455090300dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:35.289570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da97e2-bc7a-4b21-a521-4455090300dc service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:35.297648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 706/1400] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:24:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:24:35.513967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8a95b-e2dd-4ee1-a458-799dfedda2b9 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:35.514254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8a95b-e2dd-4ee1-a458-799dfedda2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:35.514533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8a95b-e2dd-4ee1-a458-799dfedda2b9 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:35.515907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 695/1401] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:35.521012 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca98118-5649-4f07-a1cb-54244975604b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:35.521295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca98118-5649-4f07-a1cb-54244975604b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:35.521567 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca98118-5649-4f07-a1cb-54244975604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:35.588286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2ca98118-5649-4f07-a1cb-54244975604b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:35.589473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2ca98118-5649-4f07-a1cb-54244975604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:35.643764 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:35.685045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 707/1402] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:35.978003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8a95b-e2dd-4ee1-a458-799dfedda2b9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:35.979522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ced8a95b-e2dd-4ee1-a458-799dfedda2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:36.149541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8a95b-e2dd-4ee1-a458-799dfedda2b9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:36.180204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:36.277508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c813b-2b6d-4697-a90f-38b80e48227c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:36.278119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c813b-2b6d-4697-a90f-38b80e48227c service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:36.278397 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c813b-2b6d-4697-a90f-38b80e48227c service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:36.278662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c813b-2b6d-4697-a90f-38b80e48227c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:36.282387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-344c813b-2b6d-4697-a90f-38b80e48227c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:36.379809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c813b-2b6d-4697-a90f-38b80e48227c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:36.381439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c813b-2b6d-4697-a90f-38b80e48227c service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:36.402822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 696/1403] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:38.455435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5223-61c1-46ed-9db5-b720739814f6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:38.456082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5223-61c1-46ed-9db5-b720739814f6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:38.456082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5223-61c1-46ed-9db5-b720739814f6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:38.457404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 708/1404] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:38.463078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caafc15-8ce9-48f3-8e11-3d6ebedef1df None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:38.463078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caafc15-8ce9-48f3-8e11-3d6ebedef1df None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:38.463592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caafc15-8ce9-48f3-8e11-3d6ebedef1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:38.502757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:38.537861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5caafc15-8ce9-48f3-8e11-3d6ebedef1df None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:38.540275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5caafc15-8ce9-48f3-8e11-3d6ebedef1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:38.651786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 697/1405] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:38.947674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5223-61c1-46ed-9db5-b720739814f6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:38.949247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4fda5223-61c1-46ed-9db5-b720739814f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:39.113632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5223-61c1-46ed-9db5-b720739814f6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:39.158828 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:39.235739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fa35-c8d6-40bf-87b0-b9bfb9de2a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:39.236481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fa35-c8d6-40bf-87b0-b9bfb9de2a55 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:39.236825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fa35-c8d6-40bf-87b0-b9bfb9de2a55 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:39.237163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fa35-c8d6-40bf-87b0-b9bfb9de2a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:39.238880 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4643fa35-c8d6-40bf-87b0-b9bfb9de2a55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:39.335212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643fa35-c8d6-40bf-87b0-b9bfb9de2a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:39.336952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643fa35-c8d6-40bf-87b0-b9bfb9de2a55 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:39.356512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 709/1406] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:41.462826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba8ef3-5a6b-4ac5-a903-0c571de20cab None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:41.463396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba8ef3-5a6b-4ac5-a903-0c571de20cab None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:41.463396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba8ef3-5a6b-4ac5-a903-0c571de20cab None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:41.467932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 698/1407] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:41.470071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b099f-8c30-45ec-989e-946e7dcd3cb3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:41.470514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b099f-8c30-45ec-989e-946e7dcd3cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:41.470612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b099f-8c30-45ec-989e-946e7dcd3cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:41.536979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:41.545996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-281b099f-8c30-45ec-989e-946e7dcd3cb3 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:41.547240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-281b099f-8c30-45ec-989e-946e7dcd3cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:41.656825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 710/1408] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:41.943005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba8ef3-5a6b-4ac5-a903-0c571de20cab None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:24:41.944540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4bba8ef3-5a6b-4ac5-a903-0c571de20cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:42.065292 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:42.112403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba8ef3-5a6b-4ac5-a903-0c571de20cab None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:24:42.252553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aaca2-9fdd-45c4-8fd1-e303de4e2994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:24:42.253365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aaca2-9fdd-45c4-8fd1-e303de4e2994 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:42.253732 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aaca2-9fdd-45c4-8fd1-e303de4e2994 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:42.254198 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aaca2-9fdd-45c4-8fd1-e303de4e2994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:42.255840 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d63aaca2-9fdd-45c4-8fd1-e303de4e2994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:42.346776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:42.395144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aaca2-9fdd-45c4-8fd1-e303de4e2994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:24:42.395144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aaca2-9fdd-45c4-8fd1-e303de4e2994 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:24:42.405272 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 699/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:24:51.654932 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=44 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:52.439071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=14 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:58.426782 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429a55-84f7-428a-ad60-0b400b0c6424 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:58.427334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429a55-84f7-428a-ad60-0b400b0c6424 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:58.427334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429a55-84f7-428a-ad60-0b400b0c6424 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:58.428735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 711/1410] 10.222.0.55 () {54 vars in 918 bytes} [Fri Sep 2 09:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:58.433866 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fcde7-b839-4a41-91cb-b7685d7f7fb1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:58.434294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fcde7-b839-4a41-91cb-b7685d7f7fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:58.434444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fcde7-b839-4a41-91cb-b7685d7f7fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:58.509352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-eb5fcde7-b839-4a41-91cb-b7685d7f7fb1 None None] MFA Rules not processed for user `d1d19d1439914eac9993bf31fa4c9384`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:58.510554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-eb5fcde7-b839-4a41-91cb-b7685d7f7fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:58.615081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 700/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Fri Sep 2 09:24:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:24:58.629564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1ff8d-81ea-4a86-b5e4-5239a4adb5b1 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:58.629846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1ff8d-81ea-4a86-b5e4-5239a4adb5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:58.630118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1ff8d-81ea-4a86-b5e4-5239a4adb5b1 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:58.631456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 712/1412] 10.222.0.55 () {54 vars in 918 bytes} [Fri Sep 2 09:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:24:58.635932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbad80-adba-461b-a98d-b834daa1ec2b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:24:58.636225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbad80-adba-461b-a98d-b834daa1ec2b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:24:58.636502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbad80-adba-461b-a98d-b834daa1ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:24:58.709534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:24:58.712493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6bcbad80-adba-461b-a98d-b834daa1ec2b None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:24:58.713695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6bcbad80-adba-461b-a98d-b834daa1ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:24:58.831507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 701/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Fri Sep 2 09:24:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:01.170581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65227-0f3a-4574-baad-2825b760402f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:01.173054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65227-0f3a-4574-baad-2825b760402f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:01.173054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65227-0f3a-4574-baad-2825b760402f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:01.173054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:01.178339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850e14b-dbb4-4969-9282-abcbc82c4d96 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:01.178735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850e14b-dbb4-4969-9282-abcbc82c4d96 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:01.178949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850e14b-dbb4-4969-9282-abcbc82c4d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:01.244634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8850e14b-dbb4-4969-9282-abcbc82c4d96 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:01.245815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8850e14b-dbb4-4969-9282-abcbc82c4d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:01.299442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:01.340752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:01.628153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65227-0f3a-4574-baad-2825b760402f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:01.629700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-03f65227-0f3a-4574-baad-2825b760402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:01.773264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65227-0f3a-4574-baad-2825b760402f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:01.844048 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:01.884799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597ab11-8fd8-4b2d-a86a-da371995482a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:01.885338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ab11-8fd8-4b2d-a86a-da371995482a service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:01.885635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ab11-8fd8-4b2d-a86a-da371995482a service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:01.885886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ab11-8fd8-4b2d-a86a-da371995482a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:01.887484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5597ab11-8fd8-4b2d-a86a-da371995482a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:01.974696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597ab11-8fd8-4b2d-a86a-da371995482a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:01.976336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597ab11-8fd8-4b2d-a86a-da371995482a service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:01.994696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 714/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:02.886588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3e03a-f6eb-4ec5-83b7-6a7e5c558be2 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:02.887047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3e03a-f6eb-4ec5-83b7-6a7e5c558be2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:02.887154 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3e03a-f6eb-4ec5-83b7-6a7e5c558be2 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:02.888540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:02.893412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24176330-f456-432a-9620-27a71c88bfe6 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:02.893852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24176330-f456-432a-9620-27a71c88bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:02.893952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24176330-f456-432a-9620-27a71c88bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:02.969600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-24176330-f456-432a-9620-27a71c88bfe6 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:02.970829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-24176330-f456-432a-9620-27a71c88bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:02.998051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:03.066219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:03.219418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3e03a-f6eb-4ec5-83b7-6a7e5c558be2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:03.220914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0cc3e03a-f6eb-4ec5-83b7-6a7e5c558be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:03.364663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3e03a-f6eb-4ec5-83b7-6a7e5c558be2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:03.405199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:03.476344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda500a5-26e6-49cd-8a55-6d1cab83675b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:03.476866 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda500a5-26e6-49cd-8a55-6d1cab83675b service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:03.477139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda500a5-26e6-49cd-8a55-6d1cab83675b service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:03.477403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda500a5-26e6-49cd-8a55-6d1cab83675b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:03.478969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bda500a5-26e6-49cd-8a55-6d1cab83675b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:03.565240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda500a5-26e6-49cd-8a55-6d1cab83675b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:03.566813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda500a5-26e6-49cd-8a55-6d1cab83675b service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:03.584743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 704/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:04.465318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64aa5-fe46-4fd5-9857-ce32dee85251 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:04.465873 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64aa5-fe46-4fd5-9857-ce32dee85251 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:04.465873 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64aa5-fe46-4fd5-9857-ce32dee85251 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:04.467247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:04.472222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7bced-02e0-40ae-a17d-e564fbfd666b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:04.472697 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7bced-02e0-40ae-a17d-e564fbfd666b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:04.472794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7bced-02e0-40ae-a17d-e564fbfd666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:04.527147 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:04.549166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c5b7bced-02e0-40ae-a17d-e564fbfd666b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:04.550353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c5b7bced-02e0-40ae-a17d-e564fbfd666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:04.644040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:04.795676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64aa5-fe46-4fd5-9857-ce32dee85251 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:04.797132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9ff64aa5-fe46-4fd5-9857-ce32dee85251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:04.940620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64aa5-fe46-4fd5-9857-ce32dee85251 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:04.952857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:05.050451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797ee90-0ef4-4c64-9b35-5c3fca079e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:05.051053 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797ee90-0ef4-4c64-9b35-5c3fca079e80 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:05.051832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797ee90-0ef4-4c64-9b35-5c3fca079e80 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:05.052142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797ee90-0ef4-4c64-9b35-5c3fca079e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:05.053717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d797ee90-0ef4-4c64-9b35-5c3fca079e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:05.140697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797ee90-0ef4-4c64-9b35-5c3fca079e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:05.142283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797ee90-0ef4-4c64-9b35-5c3fca079e80 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:05.159577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 717/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:06.009404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f9a44-511b-4f03-bb6b-7f3aefc2eeb7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:06.009858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f9a44-511b-4f03-bb6b-7f3aefc2eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:06.009858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f9a44-511b-4f03-bb6b-7f3aefc2eeb7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:06.011278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:06.016101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efad98-f15a-4158-9609-5b216e8e99e8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:06.016507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efad98-f15a-4158-9609-5b216e8e99e8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:06.016659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efad98-f15a-4158-9609-5b216e8e99e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:06.037309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:06.092500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e1efad98-f15a-4158-9609-5b216e8e99e8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:06.093704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e1efad98-f15a-4158-9609-5b216e8e99e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:06.188094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:06.337453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f9a44-511b-4f03-bb6b-7f3aefc2eeb7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:06.338966 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5b2f9a44-511b-4f03-bb6b-7f3aefc2eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:06.447049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:06.482401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f9a44-511b-4f03-bb6b-7f3aefc2eeb7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:06.595186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef2da7-4b0d-4aba-b7ed-2d6ca9257d4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:06.595719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef2da7-4b0d-4aba-b7ed-2d6ca9257d4a service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:06.596026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef2da7-4b0d-4aba-b7ed-2d6ca9257d4a service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:06.596302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef2da7-4b0d-4aba-b7ed-2d6ca9257d4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:06.597894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a5ef2da7-4b0d-4aba-b7ed-2d6ca9257d4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:06.672931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:06.686874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef2da7-4b0d-4aba-b7ed-2d6ca9257d4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:06.688492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef2da7-4b0d-4aba-b7ed-2d6ca9257d4a service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:06.706916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 707/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:07.562625 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd480e-b30a-4920-bcfb-00fdc651e17a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:07.563177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd480e-b30a-4920-bcfb-00fdc651e17a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:07.563300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd480e-b30a-4920-bcfb-00fdc651e17a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:07.564683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:07.569487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303201aa-2d96-4e29-b58f-b1c06a78f15d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:07.569931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303201aa-2d96-4e29-b58f-b1c06a78f15d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:07.570047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303201aa-2d96-4e29-b58f-b1c06a78f15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:07.644911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-303201aa-2d96-4e29-b58f-b1c06a78f15d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:07.646627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-303201aa-2d96-4e29-b58f-b1c06a78f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:07.741621 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:07.891241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd480e-b30a-4920-bcfb-00fdc651e17a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:07.892812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d4fd480e-b30a-4920-bcfb-00fdc651e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:07.976799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:08.154834 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd480e-b30a-4920-bcfb-00fdc651e17a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:08.263934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb8928-2534-4173-ada7-2062a2104784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:08.264532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb8928-2534-4173-ada7-2062a2104784 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:08.264805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb8928-2534-4173-ada7-2062a2104784 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:08.265076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb8928-2534-4173-ada7-2062a2104784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:08.266673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a3fb8928-2534-4173-ada7-2062a2104784 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:08.313649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:08.353246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb8928-2534-4173-ada7-2062a2104784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:08.354971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb8928-2534-4173-ada7-2062a2104784 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:08.373719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 720/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:09.235256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe05e5f-9cd1-4b1d-a41c-de72b1b18b97 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:09.235820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe05e5f-9cd1-4b1d-a41c-de72b1b18b97 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:09.235820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe05e5f-9cd1-4b1d-a41c-de72b1b18b97 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:09.237092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:09.241878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246395c5-c2e2-4199-99ec-54cd3ed1af82 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:09.242314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246395c5-c2e2-4199-99ec-54cd3ed1af82 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:09.242426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246395c5-c2e2-4199-99ec-54cd3ed1af82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:09.316006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-246395c5-c2e2-4199-99ec-54cd3ed1af82 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:09.317726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-246395c5-c2e2-4199-99ec-54cd3ed1af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:09.411661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:09.560373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe05e5f-9cd1-4b1d-a41c-de72b1b18b97 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:09.561901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4fe05e5f-9cd1-4b1d-a41c-de72b1b18b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:09.610263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:09.713363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe05e5f-9cd1-4b1d-a41c-de72b1b18b97 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:09.826338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d8a15-1bc1-4530-810e-19a64eab5d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:09.826865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d8a15-1bc1-4530-810e-19a64eab5d4b service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:09.827139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d8a15-1bc1-4530-810e-19a64eab5d4b service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:09.827410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d8a15-1bc1-4530-810e-19a64eab5d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:09.829040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e27d8a15-1bc1-4530-810e-19a64eab5d4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:09.835953 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:09.917591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d8a15-1bc1-4530-810e-19a64eab5d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:09.919193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d8a15-1bc1-4530-810e-19a64eab5d4b service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:09.937436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 710/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:10.801354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaca28-4a1d-4010-a222-c8eee4f5b397 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:10.801791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaca28-4a1d-4010-a222-c8eee4f5b397 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:10.801907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaca28-4a1d-4010-a222-c8eee4f5b397 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:10.803275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:10.808130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f501c-dd28-42b0-9b35-8927a336f170 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:10.808528 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f501c-dd28-42b0-9b35-8927a336f170 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:10.808673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f501c-dd28-42b0-9b35-8927a336f170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:10.885860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-334f501c-dd28-42b0-9b35-8927a336f170 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:10.887154 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-334f501c-dd28-42b0-9b35-8927a336f170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:10.953397 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:10.981965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:11.134788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaca28-4a1d-4010-a222-c8eee4f5b397 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:11.136310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a4aaca28-4a1d-4010-a222-c8eee4f5b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:11.154811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:11.281236 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaca28-4a1d-4010-a222-c8eee4f5b397 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:11.364991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:11.390063 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c93a0-2555-4adc-b187-6c589cbccf63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:11.390609 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c93a0-2555-4adc-b187-6c589cbccf63 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:11.390932 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c93a0-2555-4adc-b187-6c589cbccf63 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:11.391379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c93a0-2555-4adc-b187-6c589cbccf63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:11.393513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-691c93a0-2555-4adc-b187-6c589cbccf63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:11.480277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c93a0-2555-4adc-b187-6c589cbccf63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:11.481859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c93a0-2555-4adc-b187-6c589cbccf63 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:11.500151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 723/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:12.348154 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f1b6-31cd-46d4-ad6f-3fca5c1fc9a7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:12.348675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f1b6-31cd-46d4-ad6f-3fca5c1fc9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:12.348790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f1b6-31cd-46d4-ad6f-3fca5c1fc9a7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:12.350088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:12.355189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeca696-bb9e-4400-9140-6ec41e6eba4c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:12.355636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeca696-bb9e-4400-9140-6ec41e6eba4c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:12.355738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeca696-bb9e-4400-9140-6ec41e6eba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:12.430229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ebeca696-bb9e-4400-9140-6ec41e6eba4c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:12.431348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ebeca696-bb9e-4400-9140-6ec41e6eba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:12.472138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:12.527117 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:12.674613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8f1b6-31cd-46d4-ad6f-3fca5c1fc9a7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:12.676234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-32a8f1b6-31cd-46d4-ad6f-3fca5c1fc9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:12.822166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8f1b6-31cd-46d4-ad6f-3fca5c1fc9a7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:12.876581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:12.935119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc53d6d-6566-4e18-b828-c1a585eb54cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:12.935725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53d6d-6566-4e18-b828-c1a585eb54cd service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:12.936030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53d6d-6566-4e18-b828-c1a585eb54cd service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:12.936303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53d6d-6566-4e18-b828-c1a585eb54cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:12.937870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-dfc53d6d-6566-4e18-b828-c1a585eb54cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:13.023311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc53d6d-6566-4e18-b828-c1a585eb54cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:13.024909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc53d6d-6566-4e18-b828-c1a585eb54cd service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:13.042693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 713/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:13.951774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb192b-e81e-48fe-bdb7-f5d83b36b626 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:13.952369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb192b-e81e-48fe-bdb7-f5d83b36b626 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:13.952369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb192b-e81e-48fe-bdb7-f5d83b36b626 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:13.953681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:13.959635 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d9d19-c377-4b9a-a037-70708abe67be None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:13.960101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d9d19-c377-4b9a-a037-70708abe67be None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:13.960220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d9d19-c377-4b9a-a037-70708abe67be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:14.035247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-807d9d19-c377-4b9a-a037-70708abe67be None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:14.036487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-807d9d19-c377-4b9a-a037-70708abe67be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:14.038472 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:14.132879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:14.282967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb192b-e81e-48fe-bdb7-f5d83b36b626 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:14.284517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ebcb192b-e81e-48fe-bdb7-f5d83b36b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:14.429886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb192b-e81e-48fe-bdb7-f5d83b36b626 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:14.455897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:14.540752 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75fbec-b2f5-4773-85f3-502f14ddaf3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:14.541351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75fbec-b2f5-4773-85f3-502f14ddaf3f service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:14.541627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75fbec-b2f5-4773-85f3-502f14ddaf3f service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:14.541898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75fbec-b2f5-4773-85f3-502f14ddaf3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:14.543486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ce75fbec-b2f5-4773-85f3-502f14ddaf3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:14.630580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75fbec-b2f5-4773-85f3-502f14ddaf3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:14.632191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75fbec-b2f5-4773-85f3-502f14ddaf3f service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:14.650330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 726/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:16.483327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981167-9dae-41a3-aa29-9a0dc22f0f7e None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:16.483950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981167-9dae-41a3-aa29-9a0dc22f0f7e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:16.483950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981167-9dae-41a3-aa29-9a0dc22f0f7e None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:16.485255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:16.490423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d0ed-e999-43d3-affb-0a51d05735b1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:16.490845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d0ed-e999-43d3-affb-0a51d05735b1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:16.490955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d0ed-e999-43d3-affb-0a51d05735b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:16.531282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:16.556026 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-86a3d0ed-e999-43d3-affb-0a51d05735b1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:16.557233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-86a3d0ed-e999-43d3-affb-0a51d05735b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:16.653206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:16.945305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981167-9dae-41a3-aa29-9a0dc22f0f7e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:16.946826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e1981167-9dae-41a3-aa29-9a0dc22f0f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:17.048258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981167-9dae-41a3-aa29-9a0dc22f0f7e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:17.080137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:17.123361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289dc46-ab44-4431-b557-00b7c2d26343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:17.124002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289dc46-ab44-4431-b557-00b7c2d26343 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:17.124283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289dc46-ab44-4431-b557-00b7c2d26343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:17.124556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289dc46-ab44-4431-b557-00b7c2d26343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:17.126230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9289dc46-ab44-4431-b557-00b7c2d26343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:17.237694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289dc46-ab44-4431-b557-00b7c2d26343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:17.239730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289dc46-ab44-4431-b557-00b7c2d26343 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:17.259703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 716/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:19.305883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9112c-eee2-4ac8-bc07-b7892a25722e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:19.306453 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9112c-eee2-4ac8-bc07-b7892a25722e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:19.306453 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9112c-eee2-4ac8-bc07-b7892a25722e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:19.307751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:19.312945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e41ee2-9284-4f0b-9382-3f468b600d7f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:19.313328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e41ee2-9284-4f0b-9382-3f468b600d7f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:19.313492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e41ee2-9284-4f0b-9382-3f468b600d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:19.378295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-00e41ee2-9284-4f0b-9382-3f468b600d7f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:19.379489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-00e41ee2-9284-4f0b-9382-3f468b600d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:19.391993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:19.475823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:19.759101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9112c-eee2-4ac8-bc07-b7892a25722e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:19.760678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dad9112c-eee2-4ac8-bc07-b7892a25722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:19.864114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9112c-eee2-4ac8-bc07-b7892a25722e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:19.876304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:19.935677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96219165-75ba-4c1d-9ca5-da9a3115689e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:19.936314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96219165-75ba-4c1d-9ca5-da9a3115689e service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:19.936667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96219165-75ba-4c1d-9ca5-da9a3115689e service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:19.936938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96219165-75ba-4c1d-9ca5-da9a3115689e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:19.938515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-96219165-75ba-4c1d-9ca5-da9a3115689e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:20.044882 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96219165-75ba-4c1d-9ca5-da9a3115689e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:20.046306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96219165-75ba-4c1d-9ca5-da9a3115689e service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:20.064272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 729/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:22.273981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93957-a1b5-470c-9c74-db659c45a047 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:22.274498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93957-a1b5-470c-9c74-db659c45a047 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:22.274498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93957-a1b5-470c-9c74-db659c45a047 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:22.275872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:22.280998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26296e07-a2f0-47e3-bc8d-ff7ed1e17db2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:22.281426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26296e07-a2f0-47e3-bc8d-ff7ed1e17db2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:22.281531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26296e07-a2f0-47e3-bc8d-ff7ed1e17db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:22.328645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:22.345501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-26296e07-a2f0-47e3-bc8d-ff7ed1e17db2 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:22.346685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-26296e07-a2f0-47e3-bc8d-ff7ed1e17db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:22.440864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:22.720013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93957-a1b5-470c-9c74-db659c45a047 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:22.721541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-15a93957-a1b5-470c-9c74-db659c45a047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:22.825471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93957-a1b5-470c-9c74-db659c45a047 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:22.865987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:22.899035 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90276b8-f778-46f2-b8c9-7771e9d5d8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:22.899642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90276b8-f778-46f2-b8c9-7771e9d5d8ea service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:22.899952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90276b8-f778-46f2-b8c9-7771e9d5d8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:22.900230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90276b8-f778-46f2-b8c9-7771e9d5d8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:22.901825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b90276b8-f778-46f2-b8c9-7771e9d5d8ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:23.009596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90276b8-f778-46f2-b8c9-7771e9d5d8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:23.010977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90276b8-f778-46f2-b8c9-7771e9d5d8ea service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:23.028348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 719/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:25.042823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c050d-ff4c-4c89-98e6-4b6ce2263fe2 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:25.043384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c050d-ff4c-4c89-98e6-4b6ce2263fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:25.043384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c050d-ff4c-4c89-98e6-4b6ce2263fe2 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:25.044755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:25.050063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77f2d-3945-49b7-8ee9-93e88166fcdb None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:25.050471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77f2d-3945-49b7-8ee9-93e88166fcdb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:25.050616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77f2d-3945-49b7-8ee9-93e88166fcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:25.116152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-90f77f2d-3945-49b7-8ee9-93e88166fcdb None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:25.117287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-90f77f2d-3945-49b7-8ee9-93e88166fcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:25.138398 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:25.214180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:25.499904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c050d-ff4c-4c89-98e6-4b6ce2263fe2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:25.501443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-062c050d-ff4c-4c89-98e6-4b6ce2263fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:25.603322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c050d-ff4c-4c89-98e6-4b6ce2263fe2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:25.623519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:25.677591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b2c7c-7517-4d2f-b6c1-1f6a3f203f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:25.678192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b2c7c-7517-4d2f-b6c1-1f6a3f203f44 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:25.678463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b2c7c-7517-4d2f-b6c1-1f6a3f203f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:25.678725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b2c7c-7517-4d2f-b6c1-1f6a3f203f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:25.680342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-247b2c7c-7517-4d2f-b6c1-1f6a3f203f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:25.785840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b2c7c-7517-4d2f-b6c1-1f6a3f203f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:25.788136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b2c7c-7517-4d2f-b6c1-1f6a3f203f44 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:25.806595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 732/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:27.747308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d3b8-4f72-47b2-8b49-3f30d8d538ee None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:27.747904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d3b8-4f72-47b2-8b49-3f30d8d538ee None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:27.747904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d3b8-4f72-47b2-8b49-3f30d8d538ee None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:27.749475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:27.754611 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0653dd1-71b0-41cb-b42f-ecf84e060330 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:27.755032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0653dd1-71b0-41cb-b42f-ecf84e060330 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:27.755765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0653dd1-71b0-41cb-b42f-ecf84e060330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:27.816534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:27.819716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b0653dd1-71b0-41cb-b42f-ecf84e060330 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:27.820957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b0653dd1-71b0-41cb-b42f-ecf84e060330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:27.917064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:28.199942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154d3b8-4f72-47b2-8b49-3f30d8d538ee None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:28.201494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b154d3b8-4f72-47b2-8b49-3f30d8d538ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:28.303785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154d3b8-4f72-47b2-8b49-3f30d8d538ee None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:28.351988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:28.377875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f39469-71da-4e1e-8a30-18ed6c15dfda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:28.378475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f39469-71da-4e1e-8a30-18ed6c15dfda service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:28.378748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f39469-71da-4e1e-8a30-18ed6c15dfda service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:28.379012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f39469-71da-4e1e-8a30-18ed6c15dfda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:28.380624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-35f39469-71da-4e1e-8a30-18ed6c15dfda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:28.487910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f39469-71da-4e1e-8a30-18ed6c15dfda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:28.489296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f39469-71da-4e1e-8a30-18ed6c15dfda service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:28.508838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 722/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:30.472706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb90a-a1d5-4f25-b8c1-62e7285c9b6a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:30.473233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb90a-a1d5-4f25-b8c1-62e7285c9b6a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:30.473233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb90a-a1d5-4f25-b8c1-62e7285c9b6a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:30.474537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:30.479682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21887001-7179-4e7f-aca5-ad4c4426a427 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:30.480107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21887001-7179-4e7f-aca5-ad4c4426a427 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:30.480253 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21887001-7179-4e7f-aca5-ad4c4426a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:30.545969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-21887001-7179-4e7f-aca5-ad4c4426a427 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:30.547158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-21887001-7179-4e7f-aca5-ad4c4426a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:30.575966 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:30.642147 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:30.925662 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79deb90a-a1d5-4f25-b8c1-62e7285c9b6a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:30.927860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-79deb90a-a1d5-4f25-b8c1-62e7285c9b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:31.027862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79deb90a-a1d5-4f25-b8c1-62e7285c9b6a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:31.056590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:31.100556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50948e6-2cde-4a4c-ac7a-45cb58642d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:31.101090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50948e6-2cde-4a4c-ac7a-45cb58642d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:31.101365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50948e6-2cde-4a4c-ac7a-45cb58642d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:31.101636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50948e6-2cde-4a4c-ac7a-45cb58642d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:31.103217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a50948e6-2cde-4a4c-ac7a-45cb58642d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:31.208689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50948e6-2cde-4a4c-ac7a-45cb58642d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:31.210105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50948e6-2cde-4a4c-ac7a-45cb58642d29 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:31.228143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 735/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:33.164975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253524-0d96-4efd-acd4-6e4a883e13f8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:33.165503 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253524-0d96-4efd-acd4-6e4a883e13f8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:33.165503 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253524-0d96-4efd-acd4-6e4a883e13f8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:33.166803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:33.172139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03821-272e-4df4-97e9-8a9e33df8df8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:33.172518 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03821-272e-4df4-97e9-8a9e33df8df8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:33.172724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03821-272e-4df4-97e9-8a9e33df8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:33.236679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0ca03821-272e-4df4-97e9-8a9e33df8df8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:33.237860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0ca03821-272e-4df4-97e9-8a9e33df8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:33.245804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:33.334345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:33.617081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81253524-0d96-4efd-acd4-6e4a883e13f8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:33.618716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-81253524-0d96-4efd-acd4-6e4a883e13f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:33.726456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81253524-0d96-4efd-acd4-6e4a883e13f8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:33.780376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:33.798736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd5a7a-cfff-4e6d-b1c5-6289dd9fdf49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:33.799340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5a7a-cfff-4e6d-b1c5-6289dd9fdf49 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:33.799629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5a7a-cfff-4e6d-b1c5-6289dd9fdf49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:33.799904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5a7a-cfff-4e6d-b1c5-6289dd9fdf49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:33.801483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5ecd5a7a-cfff-4e6d-b1c5-6289dd9fdf49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:33.908274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd5a7a-cfff-4e6d-b1c5-6289dd9fdf49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:33.909645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd5a7a-cfff-4e6d-b1c5-6289dd9fdf49 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:33.928309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 725/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:35.875074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278d548-ccb2-4c62-adbb-a40e79ed646d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:35.875534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278d548-ccb2-4c62-adbb-a40e79ed646d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:35.875660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278d548-ccb2-4c62-adbb-a40e79ed646d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:35.877025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:35.882232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b6d15-e54a-40de-8d27-0aa388902f23 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:35.882632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b6d15-e54a-40de-8d27-0aa388902f23 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:35.882778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b6d15-e54a-40de-8d27-0aa388902f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:35.947958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-095b6d15-e54a-40de-8d27-0aa388902f23 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:35.949152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-095b6d15-e54a-40de-8d27-0aa388902f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:35.987186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:36.045633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:36.326030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278d548-ccb2-4c62-adbb-a40e79ed646d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:36.327542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e278d548-ccb2-4c62-adbb-a40e79ed646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:36.428479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278d548-ccb2-4c62-adbb-a40e79ed646d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:36.465582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:36.499889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baaf01-129c-40f3-8ed5-5f2d17fef3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:36.500505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baaf01-129c-40f3-8ed5-5f2d17fef3df service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:36.500781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baaf01-129c-40f3-8ed5-5f2d17fef3df service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:36.501051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baaf01-129c-40f3-8ed5-5f2d17fef3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:36.502631 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a6baaf01-129c-40f3-8ed5-5f2d17fef3df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:36.608108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baaf01-129c-40f3-8ed5-5f2d17fef3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:36.609461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baaf01-129c-40f3-8ed5-5f2d17fef3df service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:36.629095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 738/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:25:38.550949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d30945-e5fd-4466-9a31-ec5d45383bda None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:38.551464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d30945-e5fd-4466-9a31-ec5d45383bda None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:38.551593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d30945-e5fd-4466-9a31-ec5d45383bda None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:38.553510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:38.558771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301ef90-141c-46a9-a8cd-f138088769ac None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:38.559154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301ef90-141c-46a9-a8cd-f138088769ac None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:38.559345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301ef90-141c-46a9-a8cd-f138088769ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:38.623702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9301ef90-141c-46a9-a8cd-f138088769ac None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:38.625228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9301ef90-141c-46a9-a8cd-f138088769ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:38.642863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:38.720585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:39.003801 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d30945-e5fd-4466-9a31-ec5d45383bda None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:39.005368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-14d30945-e5fd-4466-9a31-ec5d45383bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:39.108955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d30945-e5fd-4466-9a31-ec5d45383bda None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:39.174336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:39.180992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d4c19-0467-43d0-bf28-86e260aa63e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:39.181599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d4c19-0467-43d0-bf28-86e260aa63e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:39.181877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d4c19-0467-43d0-bf28-86e260aa63e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:39.182148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d4c19-0467-43d0-bf28-86e260aa63e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:39.183776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-624d4c19-0467-43d0-bf28-86e260aa63e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:39.290926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d4c19-0467-43d0-bf28-86e260aa63e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:39.292439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d4c19-0467-43d0-bf28-86e260aa63e2 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:39.310198 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 728/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:41.222207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f8ef1-259e-4b9f-9386-3fdb09be1602 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:41.222797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f8ef1-259e-4b9f-9386-3fdb09be1602 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:41.222797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f8ef1-259e-4b9f-9386-3fdb09be1602 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:41.224072 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:25:41.229265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c63ee-6e10-4554-b3c2-eb2659d276b1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:41.229674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c63ee-6e10-4554-b3c2-eb2659d276b1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:41.229806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c63ee-6e10-4554-b3c2-eb2659d276b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:41.295219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6d6c63ee-6e10-4554-b3c2-eb2659d276b1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:25:41.296427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6d6c63ee-6e10-4554-b3c2-eb2659d276b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:41.344626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:41.392874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:25:41.674554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f8ef1-259e-4b9f-9386-3fdb09be1602 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:25:41.676131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1c6f8ef1-259e-4b9f-9386-3fdb09be1602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:41.776541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f8ef1-259e-4b9f-9386-3fdb09be1602 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:25:41.823694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:41.850191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec7f4a-5710-4a80-b32f-7ea501273e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:25:41.850793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec7f4a-5710-4a80-b32f-7ea501273e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:25:41.851064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec7f4a-5710-4a80-b32f-7ea501273e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:25:41.851327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec7f4a-5710-4a80-b32f-7ea501273e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:25:41.853577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-11ec7f4a-5710-4a80-b32f-7ea501273e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:25:41.957744 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec7f4a-5710-4a80-b32f-7ea501273e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:25:41.959630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec7f4a-5710-4a80-b32f-7ea501273e14 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:25:41.978115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 741/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:25:51.391040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=22 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:51.975857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=66 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:02.075958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095b6d-228d-4925-ad7d-126f948b5020 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:02.076467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095b6d-228d-4925-ad7d-126f948b5020 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:02.076565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095b6d-228d-4925-ad7d-126f948b5020 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:02.077867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 730/1471] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:26:02.083045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d6de0-8ef8-40b8-9ba1-8d6866079ba1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:02.083491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d6de0-8ef8-40b8-9ba1-8d6866079ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:02.083591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d6de0-8ef8-40b8-9ba1-8d6866079ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:02.148843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5c4d6de0-8ef8-40b8-9ba1-8d6866079ba1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:26:02.149966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c4d6de0-8ef8-40b8-9ba1-8d6866079ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:02.243471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 742/1472] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:26:02.538687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3b84-ef2b-4c64-9b58-a9c39d59ab21 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:02.538961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3b84-ef2b-4c64-9b58-a9c39d59ab21 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:02.539226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3b84-ef2b-4c64-9b58-a9c39d59ab21 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:02.540665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 731/1473] 10.222.0.55 () {54 vars in 961 bytes} [Fri Sep 2 09:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:26:02.545385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935a3b6-62b6-4dd7-be50-f660eb96b95f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:02.545671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935a3b6-62b6-4dd7-be50-f660eb96b95f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:02.545939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935a3b6-62b6-4dd7-be50-f660eb96b95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:02.620020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9935a3b6-62b6-4dd7-be50-f660eb96b95f None None] MFA Rules not processed for user `2a6267b159204df7af8a4f84d227f88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:26:02.624570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9935a3b6-62b6-4dd7-be50-f660eb96b95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:02.641591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:02.695862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 743/1474] 10.222.0.55 () {58 vars in 1058 bytes} [Fri Sep 2 09:26:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:26:02.703214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f3b84-ef2b-4c64-9b58-a9c39d59ab21 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:26:02.704770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9c0f3b84-ef2b-4c64-9b58-a9c39d59ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:02.814268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f3b84-ef2b-4c64-9b58-a9c39d59ab21 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:26:02.885648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca41fb3-28b3-4bb3-9d39-d4299170b38a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6267b159204df7af8a4f84d227f88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:26:02.886247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41fb3-28b3-4bb3-9d39-d4299170b38a service glance] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:02.886520 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41fb3-28b3-4bb3-9d39-d4299170b38a service glance] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:02.886787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41fb3-28b3-4bb3-9d39-d4299170b38a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:02.888390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2ca41fb3-28b3-4bb3-9d39-d4299170b38a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:02.940802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:02.994259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca41fb3-28b3-4bb3-9d39-d4299170b38a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:26:02.995683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca41fb3-28b3-4bb3-9d39-d4299170b38a service glance] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:26:03.014195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 732/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:05.011508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf84b0-4080-4e3c-af0c-e221287c96bd None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:05.012053 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf84b0-4080-4e3c-af0c-e221287c96bd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:05.012173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf84b0-4080-4e3c-af0c-e221287c96bd None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:05.013445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 744/1476] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:26:05.018556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7a2c4-4835-415f-8181-861f2ab8671d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:05.018979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7a2c4-4835-415f-8181-861f2ab8671d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:05.019088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7a2c4-4835-415f-8181-861f2ab8671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:05.083837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d7a7a2c4-4835-415f-8181-861f2ab8671d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:26:05.085051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d7a7a2c4-4835-415f-8181-861f2ab8671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:05.179802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 733/1477] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:26:05.452808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf84b0-4080-4e3c-af0c-e221287c96bd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:26:05.454278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-06bf84b0-4080-4e3c-af0c-e221287c96bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:05.576985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf84b0-4080-4e3c-af0c-e221287c96bd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:26:05.625450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:05.670851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589c14e-5e32-426c-80e0-f521108397ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:26:05.671458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589c14e-5e32-426c-80e0-f521108397ea admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:05.671731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589c14e-5e32-426c-80e0-f521108397ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:05.672084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589c14e-5e32-426c-80e0-f521108397ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:05.672711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589c14e-5e32-426c-80e0-f521108397ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:26:05.674427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-f589c14e-5e32-426c-80e0-f521108397ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:26:05.674427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: warnings.warn(msg) Sep 02 09:26:05.674427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: Sep 02 09:26:05.675592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589c14e-5e32-426c-80e0-f521108397ea admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:26:05.694656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 745/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Fri Sep 2 09:26:05 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:26:07.610906 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38828ee-3594-41ee-94e0-6f311889bbf7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:07.611464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38828ee-3594-41ee-94e0-6f311889bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:07.611464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38828ee-3594-41ee-94e0-6f311889bbf7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:07.612841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 734/1479] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:26:07.618042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650390-bdbf-45b9-a14f-022c9022783d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:07.618430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650390-bdbf-45b9-a14f-022c9022783d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:07.618585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650390-bdbf-45b9-a14f-022c9022783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:07.685572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-89650390-bdbf-45b9-a14f-022c9022783d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:26:07.686766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-89650390-bdbf-45b9-a14f-022c9022783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:07.781336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 746/1480] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:26:08.076124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38828ee-3594-41ee-94e0-6f311889bbf7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:26:08.077773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c38828ee-3594-41ee-94e0-6f311889bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:08.087627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:08.222476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38828ee-3594-41ee-94e0-6f311889bbf7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:26:08.300651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:08.334062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324f9ee-e9b5-4fbd-9afa-a14ccf952c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:26:08.334693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324f9ee-e9b5-4fbd-9afa-a14ccf952c6a service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:08.334970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324f9ee-e9b5-4fbd-9afa-a14ccf952c6a service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:08.335241 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324f9ee-e9b5-4fbd-9afa-a14ccf952c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:08.336860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3324f9ee-e9b5-4fbd-9afa-a14ccf952c6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:08.424795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324f9ee-e9b5-4fbd-9afa-a14ccf952c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:26:08.426394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324f9ee-e9b5-4fbd-9afa-a14ccf952c6a service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:26:08.444425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 735/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:10.517391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98866a59-b922-4ee2-a3e1-8b3c7fc3fbe5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:10.518029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98866a59-b922-4ee2-a3e1-8b3c7fc3fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:10.518029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98866a59-b922-4ee2-a3e1-8b3c7fc3fbe5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:10.519308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 747/1482] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:26:10.525186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899678ac-193d-47ac-a898-b18e06ed491c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:10.525650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899678ac-193d-47ac-a898-b18e06ed491c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:10.525758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899678ac-193d-47ac-a898-b18e06ed491c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:10.590933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-899678ac-193d-47ac-a898-b18e06ed491c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:26:10.592162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-899678ac-193d-47ac-a898-b18e06ed491c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:10.638091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:10.688745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 736/1483] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:26:10.983004 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98866a59-b922-4ee2-a3e1-8b3c7fc3fbe5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:26:10.984600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-98866a59-b922-4ee2-a3e1-8b3c7fc3fbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:11.008139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:11.085642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98866a59-b922-4ee2-a3e1-8b3c7fc3fbe5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:26:11.156775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657135d-1eb2-4371-8192-be0a45007c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:26:11.157374 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657135d-1eb2-4371-8192-be0a45007c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:11.157647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657135d-1eb2-4371-8192-be0a45007c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:11.157916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657135d-1eb2-4371-8192-be0a45007c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:11.159517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c657135d-1eb2-4371-8192-be0a45007c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:11.230936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:11.267110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657135d-1eb2-4371-8192-be0a45007c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:26:11.268902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657135d-1eb2-4371-8192-be0a45007c8d service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:26:11.287074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 748/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:13.218561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44170-9f4e-428f-92d6-f89028510b64 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:13.219072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44170-9f4e-428f-92d6-f89028510b64 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:13.219072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44170-9f4e-428f-92d6-f89028510b64 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:13.220391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 737/1485] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:26:13.226176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4a391-4b77-45e0-9897-21c284fff60b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:13.226633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4a391-4b77-45e0-9897-21c284fff60b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:13.226743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4a391-4b77-45e0-9897-21c284fff60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:13.291364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8aa4a391-4b77-45e0-9897-21c284fff60b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:26:13.292595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8aa4a391-4b77-45e0-9897-21c284fff60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:13.386961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 749/1486] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:26:13.674091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb44170-9f4e-428f-92d6-f89028510b64 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:26:13.675639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bfb44170-9f4e-428f-92d6-f89028510b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:13.779990 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb44170-9f4e-428f-92d6-f89028510b64 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:26:13.851149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:13.853032 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92ca52-ca95-46f2-969a-ebb8716d3a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:26:13.853634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ca52-ca95-46f2-969a-ebb8716d3a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:13.853909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ca52-ca95-46f2-969a-ebb8716d3a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:13.854177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ca52-ca95-46f2-969a-ebb8716d3a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:13.855773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6d92ca52-ca95-46f2-969a-ebb8716d3a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:13.963395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92ca52-ca95-46f2-969a-ebb8716d3a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:26:13.964885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92ca52-ca95-46f2-969a-ebb8716d3a05 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:26:13.982462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 738/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:16.067745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90012d4-7645-4c03-8f1a-c52f7f6efcfb None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:16.068273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90012d4-7645-4c03-8f1a-c52f7f6efcfb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:16.068392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90012d4-7645-4c03-8f1a-c52f7f6efcfb None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:16.069736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 750/1488] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:26:16.074815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0049c-4393-4049-a900-a910dce11464 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:16.075243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0049c-4393-4049-a900-a910dce11464 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:16.075348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0049c-4393-4049-a900-a910dce11464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:16.141147 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-26d0049c-4393-4049-a900-a910dce11464 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:26:16.142267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-26d0049c-4393-4049-a900-a910dce11464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:16.194294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:16.237737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 739/1489] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:26:16.527861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90012d4-7645-4c03-8f1a-c52f7f6efcfb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:26:16.529494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e90012d4-7645-4c03-8f1a-c52f7f6efcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:16.564812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:16.630946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90012d4-7645-4c03-8f1a-c52f7f6efcfb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:26:16.703531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af809868-5a10-4f3b-a30c-a1e4dbc185dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:26:16.704200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809868-5a10-4f3b-a30c-a1e4dbc185dc service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:16.704472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809868-5a10-4f3b-a30c-a1e4dbc185dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:16.704738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809868-5a10-4f3b-a30c-a1e4dbc185dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:16.706300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-af809868-5a10-4f3b-a30c-a1e4dbc185dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:16.785437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:16.813985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af809868-5a10-4f3b-a30c-a1e4dbc185dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:26:16.815415 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af809868-5a10-4f3b-a30c-a1e4dbc185dc service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:26:16.834428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 751/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:19.230231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d03ff-e287-45e0-a402-63b1640ad3c0 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:19.230744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d03ff-e287-45e0-a402-63b1640ad3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:19.230744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d03ff-e287-45e0-a402-63b1640ad3c0 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:19.232097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 740/1491] 10.222.0.55 () {54 vars in 927 bytes} [Fri Sep 2 09:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:26:19.237319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309af31-4235-4d97-84d5-9910c2a7325e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:19.237785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309af31-4235-4d97-84d5-9910c2a7325e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:19.237897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309af31-4235-4d97-84d5-9910c2a7325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:19.304898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8309af31-4235-4d97-84d5-9910c2a7325e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:26:19.306133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8309af31-4235-4d97-84d5-9910c2a7325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:19.400513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 752/1492] 10.222.0.55 () {58 vars in 1024 bytes} [Fri Sep 2 09:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:26:19.684729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d03ff-e287-45e0-a402-63b1640ad3c0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:26:19.686255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-554d03ff-e287-45e0-a402-63b1640ad3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:19.789069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d03ff-e287-45e0-a402-63b1640ad3c0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:26:19.863175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089dff9-ec52-49d5-aee6-c39a657d534b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:26:19.863780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089dff9-ec52-49d5-aee6-c39a657d534b service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:26:19.864088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089dff9-ec52-49d5-aee6-c39a657d534b service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:26:19.864364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089dff9-ec52-49d5-aee6-c39a657d534b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:26:19.865952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a089dff9-ec52-49d5-aee6-c39a657d534b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:26:19.874881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:19.973846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089dff9-ec52-49d5-aee6-c39a657d534b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:26:19.975247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089dff9-ec52-49d5-aee6-c39a657d534b service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:26:19.992711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 741/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:29.398705 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=82 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:29.990440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=50 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:40.920256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902539bc-df32-4b0f-af33-a7ab27acb430 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:40.920859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902539bc-df32-4b0f-af33-a7ab27acb430 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:40.920859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902539bc-df32-4b0f-af33-a7ab27acb430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:40.995115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-902539bc-df32-4b0f-af33-a7ab27acb430 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:27:40.996327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-902539bc-df32-4b0f-af33-a7ab27acb430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:41.089340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 753/1494] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:27:41.097962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116eded-d936-4de1-a7b6-148212f1985a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:41.098473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116eded-d936-4de1-a7b6-148212f1985a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:41.098584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116eded-d936-4de1-a7b6-148212f1985a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:41.172706 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a116eded-d936-4de1-a7b6-148212f1985a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:27:41.173913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a116eded-d936-4de1-a7b6-148212f1985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:41.268219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 742/1495] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:27:41.272897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902539bc-df32-4b0f-af33-a7ab27acb430 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:27:41.274077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-902539bc-df32-4b0f-af33-a7ab27acb430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:41.285907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902539bc-df32-4b0f-af33-a7ab27acb430 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:27:41.344808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:41.376638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:27:41.377231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:41.377504 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:41.377769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:41.378395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:27:41.378687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:27:41.379687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:27:41.379687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: warnings.warn(msg) Sep 02 09:27:41.379687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: Sep 02 09:27:41.380597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:27:41.392763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 754/1496] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:27:41.400856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116eded-d936-4de1-a7b6-148212f1985a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:27:41.410578 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116eded-d936-4de1-a7b6-148212f1985a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:27:41.470628 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:41.503017 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffae279-a6fb-4e74-acc0-e7b1d1519a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:27:41.503841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffae279-a6fb-4e74-acc0-e7b1d1519a57 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:41.504194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffae279-a6fb-4e74-acc0-e7b1d1519a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:41.504624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffae279-a6fb-4e74-acc0-e7b1d1519a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:41.505585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffae279-a6fb-4e74-acc0-e7b1d1519a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:27:41.507389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: WARNING py.warnings [None req-1ffae279-a6fb-4e74-acc0-e7b1d1519a57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:27:41.507389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: warnings.warn(msg) Sep 02 09:27:41.507389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: Sep 02 09:27:41.508628 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffae279-a6fb-4e74-acc0-e7b1d1519a57 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:27:41.653144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 743/1497] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:27:41 2022] POST /identity/v3/projects => generated 379 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:27:41.657390 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:27:41.658917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:41.691850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ed304-3a44-4151-be3c-f06c8f1d1dcc admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:27:41.785068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f92b0-8209-4ee1-93b0-b88d5e0bff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:27:41.785723 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f92b0-8209-4ee1-93b0-b88d5e0bff18 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:41.786038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f92b0-8209-4ee1-93b0-b88d5e0bff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:41.786311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f92b0-8209-4ee1-93b0-b88d5e0bff18 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:41.786922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f92b0-8209-4ee1-93b0-b88d5e0bff18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:27:41.787959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-a29f92b0-8209-4ee1-93b0-b88d5e0bff18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:27:41.787959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: warnings.warn(msg) Sep 02 09:27:41.787959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: Sep 02 09:27:41.789165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f92b0-8209-4ee1-93b0-b88d5e0bff18 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:27:41.898455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 755/1498] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:27:41 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:27:41.902581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffae279-a6fb-4e74-acc0-e7b1d1519a57 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:27:41.904140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1ffae279-a6fb-4e74-acc0-e7b1d1519a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:41.965196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffae279-a6fb-4e74-acc0-e7b1d1519a57 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:27:42.046822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:42.056733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9e9e1-1937-4586-8128-a6c063aa060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:27:42.057330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9e9e1-1937-4586-8128-a6c063aa060f admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:42.057603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9e9e1-1937-4586-8128-a6c063aa060f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:42.057868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9e9e1-1937-4586-8128-a6c063aa060f admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:42.058495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9e9e1-1937-4586-8128-a6c063aa060f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:27:42.059537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: WARNING py.warnings [None req-e6f9e9e1-1937-4586-8128-a6c063aa060f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:27:42.059537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: warnings.warn(msg) Sep 02 09:27:42.059537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: Sep 02 09:27:42.060444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9e9e1-1937-4586-8128-a6c063aa060f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:27:42.073677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 744/1499] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:27:42.077767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f92b0-8209-4ee1-93b0-b88d5e0bff18 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:27:42.079290 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a29f92b0-8209-4ee1-93b0-b88d5e0bff18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:42.090677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f92b0-8209-4ee1-93b0-b88d5e0bff18 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:27:42.116038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:42.183393 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79831d-0da0-4fd3-9516-982b29a4b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:27:42.183964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79831d-0da0-4fd3-9516-982b29a4b653 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:42.184243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79831d-0da0-4fd3-9516-982b29a4b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:42.184513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79831d-0da0-4fd3-9516-982b29a4b653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:42.185145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79831d-0da0-4fd3-9516-982b29a4b653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:27:42.186153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-ef79831d-0da0-4fd3-9516-982b29a4b653 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:27:42.186153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: warnings.warn(msg) Sep 02 09:27:42.186153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: Sep 02 09:27:42.187070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79831d-0da0-4fd3-9516-982b29a4b653 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:27:42.199431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 756/1500] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:27:42.203536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9e9e1-1937-4586-8128-a6c063aa060f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:27:42.205071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e6f9e9e1-1937-4586-8128-a6c063aa060f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:42.238889 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9e9e1-1937-4586-8128-a6c063aa060f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:27:42.334680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d8bc6-fe1e-4e46-8a78-bcaea83dbda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:27:42.335340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8bc6-fe1e-4e46-8a78-bcaea83dbda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:42.335638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8bc6-fe1e-4e46-8a78-bcaea83dbda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:42.335932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8bc6-fe1e-4e46-8a78-bcaea83dbda0 admin admin] PATH_INFO: `/v3/projects/1c40504a6aa74f029f0d0daabfd3cf08/users/29467490fe1e4908949b12eb261d1fe7/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:42.357977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d8bc6-fe1e-4e46-8a78-bcaea83dbda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c40504a6aa74f029f0d0daabfd3cf08, user_id=29467490fe1e4908949b12eb261d1fe7, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:27:42.359570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: WARNING py.warnings [None req-8b5d8bc6-fe1e-4e46-8a78-bcaea83dbda0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:27:42.359570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: warnings.warn(msg) Sep 02 09:27:42.359570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: Sep 02 09:27:42.361555 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d8bc6-fe1e-4e46-8a78-bcaea83dbda0 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:27:42.521523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 745/1501] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:27:42 2022] PUT /identity/v3/projects/1c40504a6aa74f029f0d0daabfd3cf08/users/29467490fe1e4908949b12eb261d1fe7/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:27:42.533885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00efb9-d176-4f6a-8ac1-48d42c5e5335 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:42.534167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00efb9-d176-4f6a-8ac1-48d42c5e5335 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:42.534437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00efb9-d176-4f6a-8ac1-48d42c5e5335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:42.589119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2c00efb9-d176-4f6a-8ac1-48d42c5e5335 None None] MFA Rules not processed for user `29467490fe1e4908949b12eb261d1fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:27:42.590309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2c00efb9-d176-4f6a-8ac1-48d42c5e5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:42.665174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 757/1502] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:27:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:27:42.677939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000aab6-4839-4124-a83b-303a8ff0029f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:42.678250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000aab6-4839-4124-a83b-303a8ff0029f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:42.678527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000aab6-4839-4124-a83b-303a8ff0029f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:42.679865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 746/1503] 10.222.0.55 () {54 vars in 964 bytes} [Fri Sep 2 09:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:27:42.684443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf20a7-461c-420e-a171-38f47961fb5d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:42.684726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf20a7-461c-420e-a171-38f47961fb5d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:42.685006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf20a7-461c-420e-a171-38f47961fb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:42.714998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:42.757885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7caf20a7-461c-420e-a171-38f47961fb5d None None] MFA Rules not processed for user `81b6abdeca334777b597215dfe157688`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:27:42.759070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7caf20a7-461c-420e-a171-38f47961fb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:42.833288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 758/1504] 10.222.0.55 () {58 vars in 1061 bytes} [Fri Sep 2 09:27:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:27:42.843657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000aab6-4839-4124-a83b-303a8ff0029f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:27:42.845196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f000aab6-4839-4124-a83b-303a8ff0029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:42.894784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:42.953120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000aab6-4839-4124-a83b-303a8ff0029f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:27:43.025934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a87445-cfb3-4460-9a36-c8c572865de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:27:43.026536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a87445-cfb3-4460-9a36-c8c572865de6 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:43.026811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a87445-cfb3-4460-9a36-c8c572865de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:43.027080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a87445-cfb3-4460-9a36-c8c572865de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:43.028712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-74a87445-cfb3-4460-9a36-c8c572865de6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:43.126090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a87445-cfb3-4460-9a36-c8c572865de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:27:43.127454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a87445-cfb3-4460-9a36-c8c572865de6 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:27:43.130886 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:43.145213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 747/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:27:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:27:43.191366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e2fbe-7842-4c4c-a06b-27866511261f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:43.191775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e2fbe-7842-4c4c-a06b-27866511261f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:43.191954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e2fbe-7842-4c4c-a06b-27866511261f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:43.193255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 759/1506] 10.222.0.55 () {52 vars in 830 bytes} [Fri Sep 2 09:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:27:43.196799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a87445-cfb3-4460-9a36-c8c572865de6 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:27:43.198000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-74a87445-cfb3-4460-9a36-c8c572865de6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:43.294896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a87445-cfb3-4460-9a36-c8c572865de6 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:27:43.387463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:27:43.388062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:43.388340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:43.388609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] PATH_INFO: `/v3/users/29467490fe1e4908949b12eb261d1fe7` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:43.400496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29467490fe1e4908949b12eb261d1fe7)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:27:43.401521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: WARNING py.warnings [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:27:43.401521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: warnings.warn(msg) Sep 02 09:27:43.401521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: Sep 02 09:27:43.402751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:27:43.412667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:43.624668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29467490fe1e4908949b12eb261d1fe7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:27:43.625210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29467490fe1e4908949b12eb261d1fe7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:27:43.647654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29467490fe1e4908949b12eb261d1fe7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:27:43.662004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29467490fe1e4908949b12eb261d1fe7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:27:43.723698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29467490fe1e4908949b12eb261d1fe7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:27:43.729464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 748/1507] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:27:43 2022] DELETE /identity/v3/users/29467490fe1e4908949b12eb261d1fe7 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:27:43.734364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64d942-107a-4904-b59c-30fdef2e86d8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:43.734795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64d942-107a-4904-b59c-30fdef2e86d8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:43.735096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64d942-107a-4904-b59c-30fdef2e86d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:43.791282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4a64d942-107a-4904-b59c-30fdef2e86d8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:27:43.792509 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4a64d942-107a-4904-b59c-30fdef2e86d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:43.866975 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:43.879510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 760/1508] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:27:43.889179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:27:43.890439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:43.992382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea608e-4dc1-4165-8758-08f5e4b3e5b7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:27:44.165813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:44.184737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab5537-41eb-47bc-8ce3-9366cecfbfe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:27:44.185341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5537-41eb-47bc-8ce3-9366cecfbfe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:44.185663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5537-41eb-47bc-8ce3-9366cecfbfe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:44.185974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5537-41eb-47bc-8ce3-9366cecfbfe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:44.187551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f7ab5537-41eb-47bc-8ce3-9366cecfbfe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:44.294085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab5537-41eb-47bc-8ce3-9366cecfbfe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:27:44.295524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab5537-41eb-47bc-8ce3-9366cecfbfe6 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:27:44.313442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 749/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:27:44.743311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64d942-107a-4904-b59c-30fdef2e86d8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:27:44.744564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4a64d942-107a-4904-b59c-30fdef2e86d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:27:44.756973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64d942-107a-4904-b59c-30fdef2e86d8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:27:44.854702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:27:44.855330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:27:44.855607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:27:44.855875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] PATH_INFO: `/v3/projects/1c40504a6aa74f029f0d0daabfd3cf08` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:27:44.866039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c40504a6aa74f029f0d0daabfd3cf08)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:27:44.867053 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:27:44.867053 dv-cinder-850831-3-smb devstack@keystone.service[81573]: warnings.warn(msg) Sep 02 09:27:44.867053 dv-cinder-850831-3-smb devstack@keystone.service[81573]: Sep 02 09:27:44.868287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:27:44.968707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c40504a6aa74f029f0d0daabfd3cf08', 'request_id': 'req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:27:44.974556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c40504a6aa74f029f0d0daabfd3cf08', 'request_id': 'req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:27:44.987778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c40504a6aa74f029f0d0daabfd3cf08', 'request_id': 'req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:27:45.074132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] The token cache is being invalidate because project 1c40504a6aa74f029f0d0daabfd3cf08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:27:45.074418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:27:45.074967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4c1ffe3c-af86-4b60-af5d-1d4b9e880a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:27:45.076325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 761/1510] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:27:44 2022] DELETE /identity/v3/projects/1c40504a6aa74f029f0d0daabfd3cf08 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:27:54.311172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=62 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:55.072147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:29:22.381080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbce15-9d0d-4f9a-b504-6fa5f09648bc None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:22.381636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbce15-9d0d-4f9a-b504-6fa5f09648bc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:22.381636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbce15-9d0d-4f9a-b504-6fa5f09648bc None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:22.382892 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:29:22.387859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ddef8-ec30-4490-bc6b-fdfadd954051 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:22.388287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ddef8-ec30-4490-bc6b-fdfadd954051 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:22.388432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ddef8-ec30-4490-bc6b-fdfadd954051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:22.468614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5f0ddef8-ec30-4490-bc6b-fdfadd954051 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:29:22.469857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5f0ddef8-ec30-4490-bc6b-fdfadd954051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:22.570272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:29:22.721844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbce15-9d0d-4f9a-b504-6fa5f09648bc None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:29:22.728130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0dbbce15-9d0d-4f9a-b504-6fa5f09648bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:22.842439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbce15-9d0d-4f9a-b504-6fa5f09648bc None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:29:22.847829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830df13-5b8e-4bca-9e59-9bb7199f0bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:29:22.848461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830df13-5b8e-4bca-9e59-9bb7199f0bc2 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:22.848737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830df13-5b8e-4bca-9e59-9bb7199f0bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:22.849006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830df13-5b8e-4bca-9e59-9bb7199f0bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:22.857615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830df13-5b8e-4bca-9e59-9bb7199f0bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:29:22.859200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830df13-5b8e-4bca-9e59-9bb7199f0bc2 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:29:22.868716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 751/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:29:23.693271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5261a1-94ad-4b26-9f55-c66d538af55d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:23.693838 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5261a1-94ad-4b26-9f55-c66d538af55d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:23.693838 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5261a1-94ad-4b26-9f55-c66d538af55d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:23.695153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:29:23.700029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d693a0-9258-4fe0-8b0f-19993438877d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:23.700472 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d693a0-9258-4fe0-8b0f-19993438877d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:23.700580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d693a0-9258-4fe0-8b0f-19993438877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:23.720040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f7d693a0-9258-4fe0-8b0f-19993438877d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:29:23.721211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f7d693a0-9258-4fe0-8b0f-19993438877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:23.729622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:29:23.881004 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5261a1-94ad-4b26-9f55-c66d538af55d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:29:23.895917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5261a1-94ad-4b26-9f55-c66d538af55d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:29:23.902113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbfa8e-4518-4302-ae5e-2a9077a48305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:29:23.902709 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbfa8e-4518-4302-ae5e-2a9077a48305 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:23.902995 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbfa8e-4518-4302-ae5e-2a9077a48305 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:23.903489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbfa8e-4518-4302-ae5e-2a9077a48305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:23.912478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbfa8e-4518-4302-ae5e-2a9077a48305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:29:23.914064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbfa8e-4518-4302-ae5e-2a9077a48305 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:29:23.923624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 764/1516] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:29:23.934118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317313a-fbd1-46ff-9376-08bb8dbbe22c None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:23.934399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317313a-fbd1-46ff-9376-08bb8dbbe22c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:23.934788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317313a-fbd1-46ff-9376-08bb8dbbe22c None None] PATH_INFO: `/v3` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:23.936334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 753/1517] 10.222.0.30 () {54 vars in 925 bytes} [Fri Sep 2 09:29:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:29:23.942874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594568a-ecf2-4cd4-b115-a4a19b9b6e0b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:23.943155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594568a-ecf2-4cd4-b115-a4a19b9b6e0b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:23.943471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594568a-ecf2-4cd4-b115-a4a19b9b6e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:24.007927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d594568a-ecf2-4cd4-b115-a4a19b9b6e0b None None] MFA Rules not processed for user `d1d19d1439914eac9993bf31fa4c9384`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:29:24.009712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d594568a-ecf2-4cd4-b115-a4a19b9b6e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:24.027617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:29:24.081883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 765/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Fri Sep 2 09:29:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:29:33.410060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6796913-8266-4641-b018-a1dbfd593d36 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:33.410579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6796913-8266-4641-b018-a1dbfd593d36 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:33.410579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6796913-8266-4641-b018-a1dbfd593d36 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:33.411906 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 754/1519] 10.222.0.55 () {54 vars in 961 bytes} [Fri Sep 2 09:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:29:33.417476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ac65-9d65-447c-9b3b-7de52e438557 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:33.417881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ac65-9d65-447c-9b3b-7de52e438557 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:33.418030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ac65-9d65-447c-9b3b-7de52e438557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:33.437237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e1a8ac65-9d65-447c-9b3b-7de52e438557 None None] MFA Rules not processed for user `d1d19d1439914eac9993bf31fa4c9384`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:29:33.438433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e1a8ac65-9d65-447c-9b3b-7de52e438557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:33.447041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 766/1520] 10.222.0.55 () {58 vars in 1058 bytes} [Fri Sep 2 09:29:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:29:33.454437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6796913-8266-4641-b018-a1dbfd593d36 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:29:33.468107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6796913-8266-4641-b018-a1dbfd593d36 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:29:33.472997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196042c8-8cc5-4a9b-9f9f-4609e422cd85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:29:33.473574 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196042c8-8cc5-4a9b-9f9f-4609e422cd85 service placement] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:33.473849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196042c8-8cc5-4a9b-9f9f-4609e422cd85 service placement] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:33.474116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196042c8-8cc5-4a9b-9f9f-4609e422cd85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:33.482693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196042c8-8cc5-4a9b-9f9f-4609e422cd85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:29:33.484294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196042c8-8cc5-4a9b-9f9f-4609e422cd85 service placement] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:29:33.493865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 755/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:29:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:29:35.120909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93084f89-5f10-4d01-a9cb-2da2a84f3941 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:35.121449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93084f89-5f10-4d01-a9cb-2da2a84f3941 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:35.121449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93084f89-5f10-4d01-a9cb-2da2a84f3941 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:35.122827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:29:35.127469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f0ce0-6a85-4bc4-b02d-510aab004c00 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:35.127924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f0ce0-6a85-4bc4-b02d-510aab004c00 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:35.128037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f0ce0-6a85-4bc4-b02d-510aab004c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:35.147062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-969f0ce0-6a85-4bc4-b02d-510aab004c00 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:29:35.148291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-969f0ce0-6a85-4bc4-b02d-510aab004c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:35.156078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:29:35.312826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93084f89-5f10-4d01-a9cb-2da2a84f3941 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:29:35.327110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93084f89-5f10-4d01-a9cb-2da2a84f3941 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:29:35.332568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1d9b6-b766-4c82-bf04-9279820407fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:29:35.342345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1d9b6-b766-4c82-bf04-9279820407fe service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:35.342345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1d9b6-b766-4c82-bf04-9279820407fe service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:35.342345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1d9b6-b766-4c82-bf04-9279820407fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:35.342345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1d9b6-b766-4c82-bf04-9279820407fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:29:35.343808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1d9b6-b766-4c82-bf04-9279820407fe service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:29:35.354060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 768/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:29:36.189764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2b914-8250-444f-8866-c4c209bfe4a0 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:36.190266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2b914-8250-444f-8866-c4c209bfe4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:36.190383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2b914-8250-444f-8866-c4c209bfe4a0 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:36.191656 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 09:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:29:36.196989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68b991-0feb-4999-9b1b-e8abe00e450b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:36.197412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68b991-0feb-4999-9b1b-e8abe00e450b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:36.197538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68b991-0feb-4999-9b1b-e8abe00e450b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:36.217346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8c68b991-0feb-4999-9b1b-e8abe00e450b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:29:36.218568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8c68b991-0feb-4999-9b1b-e8abe00e450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:36.226926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 09:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:29:36.379278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2b914-8250-444f-8866-c4c209bfe4a0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:29:36.393926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2b914-8250-444f-8866-c4c209bfe4a0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:29:36.399212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6140b-f073-42bf-a4d5-f3232621b904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:29:36.399822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6140b-f073-42bf-a4d5-f3232621b904 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:36.400120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6140b-f073-42bf-a4d5-f3232621b904 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:36.400389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6140b-f073-42bf-a4d5-f3232621b904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:36.408216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6140b-f073-42bf-a4d5-f3232621b904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:29:36.409784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6140b-f073-42bf-a4d5-f3232621b904 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:29:36.418824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 758/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:29:40.273643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1b77-5f94-469b-bde6-4cd32a580aee None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:40.274226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1b77-5f94-469b-bde6-4cd32a580aee None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:40.274226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1b77-5f94-469b-bde6-4cd32a580aee None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:40.275515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:29:40.280695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b059e3-786d-43f5-a555-088b03f7e7dd None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:40.282603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b059e3-786d-43f5-a555-088b03f7e7dd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:40.282603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b059e3-786d-43f5-a555-088b03f7e7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:40.300816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f5b059e3-786d-43f5-a555-088b03f7e7dd None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:29:40.302002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f5b059e3-786d-43f5-a555-088b03f7e7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:40.310430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:29:40.595443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1b77-5f94-469b-bde6-4cd32a580aee None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:29:40.597329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-89cf1b77-5f94-469b-bde6-4cd32a580aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:40.678833 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1b77-5f94-469b-bde6-4cd32a580aee None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:29:40.682383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d2100-6bf8-4db5-a364-9d19f24b73c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:29:40.682988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2100-6bf8-4db5-a364-9d19f24b73c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:40.683266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2100-6bf8-4db5-a364-9d19f24b73c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:40.683538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2100-6bf8-4db5-a364-9d19f24b73c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:40.692403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d2100-6bf8-4db5-a364-9d19f24b73c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:29:40.693915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d2100-6bf8-4db5-a364-9d19f24b73c7 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:29:40.703237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 771/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:29:42.582012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb8ac-00f4-4159-ba1a-857045968883 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:42.582594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb8ac-00f4-4159-ba1a-857045968883 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:42.582594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb8ac-00f4-4159-ba1a-857045968883 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:42.583905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:29:42.589029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad981576-2862-4281-85aa-f2df0803a263 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:42.589475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad981576-2862-4281-85aa-f2df0803a263 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:42.589582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad981576-2862-4281-85aa-f2df0803a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:42.609309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ad981576-2862-4281-85aa-f2df0803a263 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:29:42.610499 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ad981576-2862-4281-85aa-f2df0803a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:42.619175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:29:42.898370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eb8ac-00f4-4159-ba1a-857045968883 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:29:42.909398 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eb8ac-00f4-4159-ba1a-857045968883 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:29:42.912887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b103ed-0542-41c1-aeb5-7a87441623d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:29:42.913472 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b103ed-0542-41c1-aeb5-7a87441623d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:42.913747 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b103ed-0542-41c1-aeb5-7a87441623d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:42.914018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b103ed-0542-41c1-aeb5-7a87441623d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:42.923252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b103ed-0542-41c1-aeb5-7a87441623d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:29:42.924814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b103ed-0542-41c1-aeb5-7a87441623d5 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:29:42.933963 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 761/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:29:46.539392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744773-5b5d-46cb-a7dc-65bb9dd07053 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:46.540118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744773-5b5d-46cb-a7dc-65bb9dd07053 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:46.540118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744773-5b5d-46cb-a7dc-65bb9dd07053 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:46.541445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:29:46.546679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3829d-75af-4a8d-bda1-9eac15159a64 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:46.547114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3829d-75af-4a8d-bda1-9eac15159a64 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:46.547219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3829d-75af-4a8d-bda1-9eac15159a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:46.554722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=81 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:29:46.566504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-59c3829d-75af-4a8d-bda1-9eac15159a64 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:29:46.577019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-59c3829d-75af-4a8d-bda1-9eac15159a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:46.577019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:29:47.122411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba744773-5b5d-46cb-a7dc-65bb9dd07053 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:29:47.124117 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ba744773-5b5d-46cb-a7dc-65bb9dd07053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:47.187304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:29:47.200006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba744773-5b5d-46cb-a7dc-65bb9dd07053 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:29:47.215139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fb4d9-0e3a-4a4b-9be6-a93f8102c2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:29:47.215139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fb4d9-0e3a-4a4b-9be6-a93f8102c2fd service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:47.215139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fb4d9-0e3a-4a4b-9be6-a93f8102c2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:47.215139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fb4d9-0e3a-4a4b-9be6-a93f8102c2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:47.215546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fb4d9-0e3a-4a4b-9be6-a93f8102c2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:29:47.215546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fb4d9-0e3a-4a4b-9be6-a93f8102c2fd service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:29:47.224087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 774/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:29:49.137955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea834de-221e-4a14-ac00-49138e80bb8b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:49.138516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea834de-221e-4a14-ac00-49138e80bb8b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:49.138516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea834de-221e-4a14-ac00-49138e80bb8b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:49.139873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 09:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:29:49.144956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ca023-67c5-4ae5-b699-4fc3d55e75c4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:49.145400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ca023-67c5-4ae5-b699-4fc3d55e75c4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:49.145511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ca023-67c5-4ae5-b699-4fc3d55e75c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:49.164927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-065ca023-67c5-4ae5-b699-4fc3d55e75c4 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:29:49.166102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-065ca023-67c5-4ae5-b699-4fc3d55e75c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:49.173726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 09:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:29:49.722065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea834de-221e-4a14-ac00-49138e80bb8b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:29:49.723741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8ea834de-221e-4a14-ac00-49138e80bb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:29:49.736556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea834de-221e-4a14-ac00-49138e80bb8b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:29:49.740061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b77a3-25d4-4153-9d26-bd4ad81edad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:29:49.740649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b77a3-25d4-4153-9d26-bd4ad81edad7 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:29:49.740924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b77a3-25d4-4153-9d26-bd4ad81edad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:29:49.740924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b77a3-25d4-4153-9d26-bd4ad81edad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:29:49.750829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b77a3-25d4-4153-9d26-bd4ad81edad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:29:49.752304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b77a3-25d4-4153-9d26-bd4ad81edad7 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:29:49.762442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 764/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:29:59.160095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=11 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:29:59.757527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=8 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:21.092671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7c6a9-5d54-4dea-88b5-633ee60e8c13 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.093465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7c6a9-5d54-4dea-88b5-633ee60e8c13 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.093465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7c6a9-5d54-4dea-88b5-633ee60e8c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.121081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-29c7c6a9-5d54-4dea-88b5-633ee60e8c13 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:21.122220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-29c7c6a9-5d54-4dea-88b5-633ee60e8c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:21.131917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 776/1540] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:31:21.142273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaab89-1c3e-4d9c-a0e2-1e83c5237cc5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.142864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaab89-1c3e-4d9c-a0e2-1e83c5237cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.142864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaab89-1c3e-4d9c-a0e2-1e83c5237cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.169566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f0eaab89-1c3e-4d9c-a0e2-1e83c5237cc5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:21.170765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f0eaab89-1c3e-4d9c-a0e2-1e83c5237cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:21.185821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 765/1541] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:31:21.190417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7c6a9-5d54-4dea-88b5-633ee60e8c13 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:21.206044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7c6a9-5d54-4dea-88b5-633ee60e8c13 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:21.215336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfc1bf-82b8-47a8-a73b-dbf9e9d4f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:21.216267 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfc1bf-82b8-47a8-a73b-dbf9e9d4f449 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.216854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfc1bf-82b8-47a8-a73b-dbf9e9d4f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.217342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfc1bf-82b8-47a8-a73b-dbf9e9d4f449 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.218203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfc1bf-82b8-47a8-a73b-dbf9e9d4f449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:21.218725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfc1bf-82b8-47a8-a73b-dbf9e9d4f449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:21.220564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfc1bf-82b8-47a8-a73b-dbf9e9d4f449 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:21.243648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 777/1542] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:21.251252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaab89-1c3e-4d9c-a0e2-1e83c5237cc5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:21.261387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaab89-1c3e-4d9c-a0e2-1e83c5237cc5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:21.271751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e6ff6-e4ac-4dcc-91df-e4574f43b2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:21.272420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e6ff6-e4ac-4dcc-91df-e4574f43b2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.272698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e6ff6-e4ac-4dcc-91df-e4574f43b2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.273513 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e6ff6-e4ac-4dcc-91df-e4574f43b2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.274267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e6ff6-e4ac-4dcc-91df-e4574f43b2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:21.276167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e6ff6-e4ac-4dcc-91df-e4574f43b2c3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:21.431416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 766/1543] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:21 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:21.435712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfc1bf-82b8-47a8-a73b-dbf9e9d4f449 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:21.453744 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfc1bf-82b8-47a8-a73b-dbf9e9d4f449 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:21.537675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef66111-298d-4787-b844-c010c48d6c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:21.538729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef66111-298d-4787-b844-c010c48d6c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.539226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef66111-298d-4787-b844-c010c48d6c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.539728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef66111-298d-4787-b844-c010c48d6c57 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.540581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef66111-298d-4787-b844-c010c48d6c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:21.542826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef66111-298d-4787-b844-c010c48d6c57 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:21.640169 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 778/1544] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:21 2022] POST /identity/v3/users => generated 284 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:21.641401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e6ff6-e4ac-4dcc-91df-e4574f43b2c3 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:21.656980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e6ff6-e4ac-4dcc-91df-e4574f43b2c3 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:21.663175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073204c-16ab-4f67-9a25-f20f081a549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:21.663854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073204c-16ab-4f67-9a25-f20f081a549a admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.668807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073204c-16ab-4f67-9a25-f20f081a549a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.668807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073204c-16ab-4f67-9a25-f20f081a549a admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.668807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073204c-16ab-4f67-9a25-f20f081a549a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:21.668807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073204c-16ab-4f67-9a25-f20f081a549a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:21.685372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 767/1545] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:21.689404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef66111-298d-4787-b844-c010c48d6c57 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:21.696113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03230a-d826-4055-921c-73a72c9b8211 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.696399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03230a-d826-4055-921c-73a72c9b8211 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.696696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03230a-d826-4055-921c-73a72c9b8211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.704881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef66111-298d-4787-b844-c010c48d6c57 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:21.710291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbb2ff-7494-4320-b621-12adbe19c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:21.714466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbb2ff-7494-4320-b621-12adbe19c0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.715017 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbb2ff-7494-4320-b621-12adbe19c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.715552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbb2ff-7494-4320-b621-12adbe19c0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.716473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbb2ff-7494-4320-b621-12adbe19c0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:21.718362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbb2ff-7494-4320-b621-12adbe19c0d9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:21.726172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8e03230a-d826-4055-921c-73a72c9b8211 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:21.727402 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8e03230a-d826-4055-921c-73a72c9b8211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:21.732094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 779/1546] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:21.737229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da958e24-1d87-4cee-8c7d-1a784f0845af None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.737777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da958e24-1d87-4cee-8c7d-1a784f0845af None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.738266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da958e24-1d87-4cee-8c7d-1a784f0845af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.742430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 768/1547] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:31:21.743240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03230a-d826-4055-921c-73a72c9b8211 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:21.761119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03230a-d826-4055-921c-73a72c9b8211 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:21.763955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-da958e24-1d87-4cee-8c7d-1a784f0845af None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:21.765202 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-da958e24-1d87-4cee-8c7d-1a784f0845af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:21.767383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d2b5b-077c-4ad9-b4c8-7b6da97135a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:21.768530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d2b5b-077c-4ad9-b4c8-7b6da97135a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.769073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d2b5b-077c-4ad9-b4c8-7b6da97135a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.769619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d2b5b-077c-4ad9-b4c8-7b6da97135a5 admin admin] PATH_INFO: `/v3/projects/d293b21ca05e48ffa00b2ae4ba64d2c0/users/fe36f8324ca446b0acf3cc339c2f38eb/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.780719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 780/1548] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:21.782513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df5e7-767b-43c5-a6d3-0e6f375778b7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.782875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df5e7-767b-43c5-a6d3-0e6f375778b7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.783227 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df5e7-767b-43c5-a6d3-0e6f375778b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.789000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d2b5b-077c-4ad9-b4c8-7b6da97135a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d293b21ca05e48ffa00b2ae4ba64d2c0, user_id=fe36f8324ca446b0acf3cc339c2f38eb, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:21.792530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d2b5b-077c-4ad9-b4c8-7b6da97135a5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:21.813715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-078df5e7-767b-43c5-a6d3-0e6f375778b7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:21.815162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-078df5e7-767b-43c5-a6d3-0e6f375778b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:21.830938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 781/1549] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:21.832393 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e964-c51f-4800-ad35-216959703ccd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.832683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e964-c51f-4800-ad35-216959703ccd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.833020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e964-c51f-4800-ad35-216959703ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.862494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-69b6e964-c51f-4800-ad35-216959703ccd None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:21.872054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-69b6e964-c51f-4800-ad35-216959703ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:21.875984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 769/1550] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:21 2022] PUT /identity/v3/projects/d293b21ca05e48ffa00b2ae4ba64d2c0/users/fe36f8324ca446b0acf3cc339c2f38eb/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:21.876997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d2b5b-077c-4ad9-b4c8-7b6da97135a5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:21.946222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 782/1551] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:21.947903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a5409-d87f-4819-a6b0-87cdf50880d4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.948419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a5409-d87f-4819-a6b0-87cdf50880d4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.948963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a5409-d87f-4819-a6b0-87cdf50880d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.971296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-463a5409-d87f-4819-a6b0-87cdf50880d4 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:21.972907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-463a5409-d87f-4819-a6b0-87cdf50880d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:21.981897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 783/1552] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:21.983568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556a43-6deb-4fd4-a645-41e01655a763 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.984078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556a43-6deb-4fd4-a645-41e01655a763 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.984591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556a43-6deb-4fd4-a645-41e01655a763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.987321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d2b5b-077c-4ad9-b4c8-7b6da97135a5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:21.993853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b1338-dc96-40ed-b82c-102b14d74ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:21.994470 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b1338-dc96-40ed-b82c-102b14d74ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:21.994749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b1338-dc96-40ed-b82c-102b14d74ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:21.995025 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b1338-dc96-40ed-b82c-102b14d74ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:21.995676 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b1338-dc96-40ed-b82c-102b14d74ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:21.996024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b1338-dc96-40ed-b82c-102b14d74ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:21.997112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: WARNING py.warnings [None req-7b6b1338-dc96-40ed-b82c-102b14d74ef2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:31:21.997112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: warnings.warn(msg) Sep 02 09:31:21.997112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: Sep 02 09:31:21.997941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b1338-dc96-40ed-b82c-102b14d74ef2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.019941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-31556a43-6deb-4fd4-a645-41e01655a763 None None] MFA Rules not processed for user `fe36f8324ca446b0acf3cc339c2f38eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:22.021571 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 770/1553] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:22.022436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b1338-dc96-40ed-b82c-102b14d74ef2 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.026167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-31556a43-6deb-4fd4-a645-41e01655a763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:22.037510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b1338-dc96-40ed-b82c-102b14d74ef2 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.049299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ab353-e047-4fd6-bf26-7ad2810d7f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.049925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab353-e047-4fd6-bf26-7ad2810d7f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.050207 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab353-e047-4fd6-bf26-7ad2810d7f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.050491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab353-e047-4fd6-bf26-7ad2810d7f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.051141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ab353-e047-4fd6-bf26-7ad2810d7f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:22.051445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ab353-e047-4fd6-bf26-7ad2810d7f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.053244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ab353-e047-4fd6-bf26-7ad2810d7f28 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.059538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:22.068056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 771/1554] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:22.071750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3614a-0624-4b28-ba2c-85feb85578ba None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.071750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3614a-0624-4b28-ba2c-85feb85578ba None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.071750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3614a-0624-4b28-ba2c-85feb85578ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.100248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e4a3614a-0624-4b28-ba2c-85feb85578ba None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:22.101581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e4a3614a-0624-4b28-ba2c-85feb85578ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:22.101846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 784/1555] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:22.103201 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789061a-6400-4de2-8a5f-a173166ff304 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.103590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789061a-6400-4de2-8a5f-a173166ff304 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.103861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789061a-6400-4de2-8a5f-a173166ff304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.110441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 772/1556] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:22.111245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3614a-0624-4b28-ba2c-85feb85578ba None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.121813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3614a-0624-4b28-ba2c-85feb85578ba None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.126482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265ec7d-8190-4ddc-bdf8-c706a4d4cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.127091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265ec7d-8190-4ddc-bdf8-c706a4d4cb63 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.127379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265ec7d-8190-4ddc-bdf8-c706a4d4cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.127636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265ec7d-8190-4ddc-bdf8-c706a4d4cb63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.128298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265ec7d-8190-4ddc-bdf8-c706a4d4cb63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.130290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265ec7d-8190-4ddc-bdf8-c706a4d4cb63 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.130416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1789061a-6400-4de2-8a5f-a173166ff304 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:22.131502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1789061a-6400-4de2-8a5f-a173166ff304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:22.140571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 785/1557] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:22.141991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337965-fca6-456d-8132-fac36256e40c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.142275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337965-fca6-456d-8132-fac36256e40c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.142550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337965-fca6-456d-8132-fac36256e40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.162359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-13337965-fca6-456d-8132-fac36256e40c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:22.164187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-13337965-fca6-456d-8132-fac36256e40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:22.172058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 786/1558] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:22.173364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826d798-1ece-4740-818d-84ef4215e49c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.173645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826d798-1ece-4740-818d-84ef4215e49c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.173915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826d798-1ece-4740-818d-84ef4215e49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.195224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d826d798-1ece-4740-818d-84ef4215e49c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:22.196500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d826d798-1ece-4740-818d-84ef4215e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:22.204361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 787/1559] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:22.211801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826d798-1ece-4740-818d-84ef4215e49c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.214495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826d798-1ece-4740-818d-84ef4215e49c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.219243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89033a9b-4790-4e44-ae3b-2aa19e78a116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.219853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89033a9b-4790-4e44-ae3b-2aa19e78a116 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.220171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89033a9b-4790-4e44-ae3b-2aa19e78a116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.220445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89033a9b-4790-4e44-ae3b-2aa19e78a116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.221132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89033a9b-4790-4e44-ae3b-2aa19e78a116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.222209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-89033a9b-4790-4e44-ae3b-2aa19e78a116 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:31:22.222209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: warnings.warn(msg) Sep 02 09:31:22.222209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: Sep 02 09:31:22.223445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89033a9b-4790-4e44-ae3b-2aa19e78a116 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.248984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 773/1560] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:22.250560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b68f0-2bfe-4b5a-82a5-99128b8f386a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.250903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b68f0-2bfe-4b5a-82a5-99128b8f386a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.251239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b68f0-2bfe-4b5a-82a5-99128b8f386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.270499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ea3b68f0-2bfe-4b5a-82a5-99128b8f386a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:22.271689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ea3b68f0-2bfe-4b5a-82a5-99128b8f386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:22.301532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:22.306431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 788/1561] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:22.307712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89033a9b-4790-4e44-ae3b-2aa19e78a116 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.334116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 774/1562] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:22.335477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daec53-089c-4c76-880c-5aa58c398253 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.335823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daec53-089c-4c76-880c-5aa58c398253 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.336131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daec53-089c-4c76-880c-5aa58c398253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.355724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b2daec53-089c-4c76-880c-5aa58c398253 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:22.356986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b2daec53-089c-4c76-880c-5aa58c398253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:22.371719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89033a9b-4790-4e44-ae3b-2aa19e78a116 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.375385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927ae3f-71d9-4e03-8a07-eed5a7574799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.376025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927ae3f-71d9-4e03-8a07-eed5a7574799 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.376303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927ae3f-71d9-4e03-8a07-eed5a7574799 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.376601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927ae3f-71d9-4e03-8a07-eed5a7574799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.415949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 775/1563] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:22.416763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daec53-089c-4c76-880c-5aa58c398253 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.425611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daec53-089c-4c76-880c-5aa58c398253 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.430779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b91c12-ed56-49cc-b060-13717c9911ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.431360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91c12-ed56-49cc-b060-13717c9911ec admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.431636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91c12-ed56-49cc-b060-13717c9911ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.431933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91c12-ed56-49cc-b060-13717c9911ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.432564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b91c12-ed56-49cc-b060-13717c9911ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:22.432869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b91c12-ed56-49cc-b060-13717c9911ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.434880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b91c12-ed56-49cc-b060-13717c9911ec admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.436738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927ae3f-71d9-4e03-8a07-eed5a7574799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.438173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927ae3f-71d9-4e03-8a07-eed5a7574799 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.445799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 776/1564] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:22.447015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e281a34-bb00-4129-a270-f1fc674743d0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.447140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 789/1565] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:22.447231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e281a34-bb00-4129-a270-f1fc674743d0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.447652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e281a34-bb00-4129-a270-f1fc674743d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.450001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76be2-afd8-4f2a-b562-68aaeb54367a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.450287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76be2-afd8-4f2a-b562-68aaeb54367a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.450565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76be2-afd8-4f2a-b562-68aaeb54367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.470792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3e281a34-bb00-4129-a270-f1fc674743d0 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:22.470995 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-94f76be2-afd8-4f2a-b562-68aaeb54367a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:22.472016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-94f76be2-afd8-4f2a-b562-68aaeb54367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:22.472168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3e281a34-bb00-4129-a270-f1fc674743d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:22.484258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 777/1566] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:22.484258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e281a34-bb00-4129-a270-f1fc674743d0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.484516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 790/1567] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:22.484958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f76be2-afd8-4f2a-b562-68aaeb54367a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.491679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e281a34-bb00-4129-a270-f1fc674743d0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.495704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f76be2-afd8-4f2a-b562-68aaeb54367a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.496755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4eee1-794a-4195-a5e5-dbb96b0c8f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.497339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4eee1-794a-4195-a5e5-dbb96b0c8f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.497610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4eee1-794a-4195-a5e5-dbb96b0c8f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.498019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4eee1-794a-4195-a5e5-dbb96b0c8f2e admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.498654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4eee1-794a-4195-a5e5-dbb96b0c8f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.499660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: WARNING py.warnings [None req-adf4eee1-794a-4195-a5e5-dbb96b0c8f2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:31:22.499660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: warnings.warn(msg) Sep 02 09:31:22.499660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: Sep 02 09:31:22.500879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4eee1-794a-4195-a5e5-dbb96b0c8f2e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.501277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b6dfa-eb48-4377-9440-1af7546c3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.502044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b6dfa-eb48-4377-9440-1af7546c3f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.502595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b6dfa-eb48-4377-9440-1af7546c3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.503024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b6dfa-eb48-4377-9440-1af7546c3f79 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.503791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b6dfa-eb48-4377-9440-1af7546c3f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.505990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b6dfa-eb48-4377-9440-1af7546c3f79 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.589497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 778/1568] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:22.590935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84584df8-b77c-43aa-8460-001810a0dcd6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.591216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84584df8-b77c-43aa-8460-001810a0dcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.591483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84584df8-b77c-43aa-8460-001810a0dcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.611842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-84584df8-b77c-43aa-8460-001810a0dcd6 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:22.613132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-84584df8-b77c-43aa-8460-001810a0dcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:22.623137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 779/1569] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:22.624349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84584df8-b77c-43aa-8460-001810a0dcd6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.627550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 791/1570] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:22.633627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b6dfa-eb48-4377-9440-1af7546c3f79 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.634487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84584df8-b77c-43aa-8460-001810a0dcd6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.639644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5b376-a9af-4c6b-a4dc-e5d7ee9a06d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.640288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5b376-a9af-4c6b-a4dc-e5d7ee9a06d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.640563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5b376-a9af-4c6b-a4dc-e5d7ee9a06d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.640837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5b376-a9af-4c6b-a4dc-e5d7ee9a06d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.641476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5b376-a9af-4c6b-a4dc-e5d7ee9a06d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:22.641588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b6dfa-eb48-4377-9440-1af7546c3f79 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.641774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5b376-a9af-4c6b-a4dc-e5d7ee9a06d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.643381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5b376-a9af-4c6b-a4dc-e5d7ee9a06d9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.652485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07e69-8395-436e-8f0e-5813551fe9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.653385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07e69-8395-436e-8f0e-5813551fe9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.653779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07e69-8395-436e-8f0e-5813551fe9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.654172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07e69-8395-436e-8f0e-5813551fe9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.655115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f07e69-8395-436e-8f0e-5813551fe9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.656788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 780/1571] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:22.657078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f07e69-8395-436e-8f0e-5813551fe9e8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.657894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5b376-a9af-4c6b-a4dc-e5d7ee9a06d9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.670258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5b376-a9af-4c6b-a4dc-e5d7ee9a06d9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.675493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:22.676458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736b8b5-f26e-4f22-9a87-e4ab31fd05ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.677289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b8b5-f26e-4f22-9a87-e4ab31fd05ab admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.677554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b8b5-f26e-4f22-9a87-e4ab31fd05ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.677948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b8b5-f26e-4f22-9a87-e4ab31fd05ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.678587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736b8b5-f26e-4f22-9a87-e4ab31fd05ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:22.678882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736b8b5-f26e-4f22-9a87-e4ab31fd05ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.680589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736b8b5-f26e-4f22-9a87-e4ab31fd05ab admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.692679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 781/1572] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:22.709636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736b8b5-f26e-4f22-9a87-e4ab31fd05ab admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.709636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736b8b5-f26e-4f22-9a87-e4ab31fd05ab admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.709636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b6934-4156-4e4c-94e7-112ef68e6df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.709636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b6934-4156-4e4c-94e7-112ef68e6df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.710230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b6934-4156-4e4c-94e7-112ef68e6df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.710230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b6934-4156-4e4c-94e7-112ef68e6df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.710230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b6934-4156-4e4c-94e7-112ef68e6df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:22.710230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b6934-4156-4e4c-94e7-112ef68e6df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.712320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b6934-4156-4e4c-94e7-112ef68e6df8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.724423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 782/1573] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:22.725661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b6934-4156-4e4c-94e7-112ef68e6df8 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.736177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b6934-4156-4e4c-94e7-112ef68e6df8 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.740824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c6582-0d48-4f25-93cc-4a00232186e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.741700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c6582-0d48-4f25-93cc-4a00232186e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.741976 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c6582-0d48-4f25-93cc-4a00232186e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.742244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c6582-0d48-4f25-93cc-4a00232186e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.742874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c6582-0d48-4f25-93cc-4a00232186e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.744510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c6582-0d48-4f25-93cc-4a00232186e7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.754773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 783/1574] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:22.755830 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c6582-0d48-4f25-93cc-4a00232186e7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.765325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c6582-0d48-4f25-93cc-4a00232186e7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.768411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 792/1575] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:22.769244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07e69-8395-436e-8f0e-5813551fe9e8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.769940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c431301-422d-4d3b-a519-c3166019ee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.770537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c431301-422d-4d3b-a519-c3166019ee69 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.770862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c431301-422d-4d3b-a519-c3166019ee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.771081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c431301-422d-4d3b-a519-c3166019ee69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.771744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c431301-422d-4d3b-a519-c3166019ee69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.773893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c431301-422d-4d3b-a519-c3166019ee69 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.784300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 784/1576] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:22.788102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c431301-422d-4d3b-a519-c3166019ee69 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.796222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c431301-422d-4d3b-a519-c3166019ee69 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.823633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:22.842988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07e69-8395-436e-8f0e-5813551fe9e8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.847839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f7e3f-5011-40e9-a7ab-296853890432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.848480 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f7e3f-5011-40e9-a7ab-296853890432 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.848760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f7e3f-5011-40e9-a7ab-296853890432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.849034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f7e3f-5011-40e9-a7ab-296853890432 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.849676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f7e3f-5011-40e9-a7ab-296853890432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:22.849994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f7e3f-5011-40e9-a7ab-296853890432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.852205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f7e3f-5011-40e9-a7ab-296853890432 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.856274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28317-d16e-4f7e-b315-3e2637bbffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.856991 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28317-d16e-4f7e-b315-3e2637bbffd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.857265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28317-d16e-4f7e-b315-3e2637bbffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.857536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28317-d16e-4f7e-b315-3e2637bbffd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.858157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea28317-d16e-4f7e-b315-3e2637bbffd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.860077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea28317-d16e-4f7e-b315-3e2637bbffd3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.872316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 793/1577] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:22.872316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f7e3f-5011-40e9-a7ab-296853890432 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.878026 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f7e3f-5011-40e9-a7ab-296853890432 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:22.883703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503dda-d7fa-41fc-8945-51a1dd5dfc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:22.884827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503dda-d7fa-41fc-8945-51a1dd5dfc0f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:22.884827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503dda-d7fa-41fc-8945-51a1dd5dfc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:22.885060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503dda-d7fa-41fc-8945-51a1dd5dfc0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:22.885620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58503dda-d7fa-41fc-8945-51a1dd5dfc0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:22.887724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58503dda-d7fa-41fc-8945-51a1dd5dfc0f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:22.968655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 785/1578] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:22.969417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28317-d16e-4f7e-b315-3e2637bbffd3 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:22.980172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 794/1579] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:22.981023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503dda-d7fa-41fc-8945-51a1dd5dfc0f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.048485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503dda-d7fa-41fc-8945-51a1dd5dfc0f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.052191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28317-d16e-4f7e-b315-3e2637bbffd3 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.053599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b741372-3abe-42e7-be7b-bdd9327fc3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.054427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b741372-3abe-42e7-be7b-bdd9327fc3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.054703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b741372-3abe-42e7-be7b-bdd9327fc3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.054973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b741372-3abe-42e7-be7b-bdd9327fc3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.055646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b741372-3abe-42e7-be7b-bdd9327fc3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.057137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54125cff-a03b-4a60-a411-fc0db369d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.057307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b741372-3abe-42e7-be7b-bdd9327fc3b6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.057764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54125cff-a03b-4a60-a411-fc0db369d0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.058026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54125cff-a03b-4a60-a411-fc0db369d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.058295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54125cff-a03b-4a60-a411-fc0db369d0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.059178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54125cff-a03b-4a60-a411-fc0db369d0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.061278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54125cff-a03b-4a60-a411-fc0db369d0e5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.071616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 795/1580] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:23.071616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b741372-3abe-42e7-be7b-bdd9327fc3b6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.078741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b741372-3abe-42e7-be7b-bdd9327fc3b6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.083383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459475-10bc-4375-a4af-63aa9a3c8b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.083999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459475-10bc-4375-a4af-63aa9a3c8b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.084279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459475-10bc-4375-a4af-63aa9a3c8b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.084549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459475-10bc-4375-a4af-63aa9a3c8b33 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.085161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94459475-10bc-4375-a4af-63aa9a3c8b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.087610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94459475-10bc-4375-a4af-63aa9a3c8b33 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.150702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 786/1581] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:22 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:23.151776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54125cff-a03b-4a60-a411-fc0db369d0e5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.205909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 796/1582] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:23 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:23.206798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459475-10bc-4375-a4af-63aa9a3c8b33 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.215873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54125cff-a03b-4a60-a411-fc0db369d0e5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.217408 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459475-10bc-4375-a4af-63aa9a3c8b33 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.220566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03458a33-fdf8-47d1-901f-740265610659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.221262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03458a33-fdf8-47d1-901f-740265610659 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.221538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03458a33-fdf8-47d1-901f-740265610659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.221848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03458a33-fdf8-47d1-901f-740265610659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.222362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3fa31-8855-4049-8dff-c74e5fdab84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.222480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03458a33-fdf8-47d1-901f-740265610659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.222944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3fa31-8855-4049-8dff-c74e5fdab84f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.223225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3fa31-8855-4049-8dff-c74e5fdab84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.223496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3fa31-8855-4049-8dff-c74e5fdab84f admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.224042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03458a33-fdf8-47d1-901f-740265610659 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.224156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3fa31-8855-4049-8dff-c74e5fdab84f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.226009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3fa31-8855-4049-8dff-c74e5fdab84f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.234052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 787/1583] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:23.235234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03458a33-fdf8-47d1-901f-740265610659 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.246339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03458a33-fdf8-47d1-901f-740265610659 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.251484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95759ae-da11-4040-80b8-5bf4856326b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.255977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95759ae-da11-4040-80b8-5bf4856326b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.256311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95759ae-da11-4040-80b8-5bf4856326b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.256643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95759ae-da11-4040-80b8-5bf4856326b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.257856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95759ae-da11-4040-80b8-5bf4856326b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.259983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95759ae-da11-4040-80b8-5bf4856326b6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.356115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 797/1584] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:23 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:23.356115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3fa31-8855-4049-8dff-c74e5fdab84f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.385958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:23.394208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 788/1585] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:23 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:23.397377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95759ae-da11-4040-80b8-5bf4856326b6 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.408447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95759ae-da11-4040-80b8-5bf4856326b6 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.422259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:23.422420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3fa31-8855-4049-8dff-c74e5fdab84f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.427785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bac16-3cc3-460c-8a24-8a418af31cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.428732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bac16-3cc3-460c-8a24-8a418af31cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.429607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bac16-3cc3-460c-8a24-8a418af31cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.429974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bac16-3cc3-460c-8a24-8a418af31cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.430882 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bac16-3cc3-460c-8a24-8a418af31cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.433200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bac16-3cc3-460c-8a24-8a418af31cb8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.471207 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ab05c-a39e-490f-8d79-a91baa32de12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.472145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ab05c-a39e-490f-8d79-a91baa32de12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.472540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ab05c-a39e-490f-8d79-a91baa32de12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.472964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ab05c-a39e-490f-8d79-a91baa32de12 admin admin] PATH_INFO: `/v3/projects/c1194ac266234e87a976710aad254782/users/cd42744b0c4b4bed8f4e59af3aeab96f/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.490275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ab05c-a39e-490f-8d79-a91baa32de12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1194ac266234e87a976710aad254782, user_id=cd42744b0c4b4bed8f4e59af3aeab96f, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.493757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ab05c-a39e-490f-8d79-a91baa32de12 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.531481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 798/1586] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:23 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:23.532331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bac16-3cc3-460c-8a24-8a418af31cb8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.542006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bac16-3cc3-460c-8a24-8a418af31cb8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.546729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea6142-5ba7-4f97-99c0-d0185e24702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.547329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea6142-5ba7-4f97-99c0-d0185e24702e admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.547630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea6142-5ba7-4f97-99c0-d0185e24702e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.547930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea6142-5ba7-4f97-99c0-d0185e24702e admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.548608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea6142-5ba7-4f97-99c0-d0185e24702e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.550600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea6142-5ba7-4f97-99c0-d0185e24702e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.618206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 789/1587] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:23 2022] PUT /identity/v3/projects/c1194ac266234e87a976710aad254782/users/cd42744b0c4b4bed8f4e59af3aeab96f/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:23.619040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ab05c-a39e-490f-8d79-a91baa32de12 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.653091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 799/1588] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:23 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:23.653331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea6142-5ba7-4f97-99c0-d0185e24702e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.665884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea6142-5ba7-4f97-99c0-d0185e24702e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.684836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ab05c-a39e-490f-8d79-a91baa32de12 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.689587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cb071-b1e1-4eeb-ae8b-ad1c4c902a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.690213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cb071-b1e1-4eeb-ae8b-ad1c4c902a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.690489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cb071-b1e1-4eeb-ae8b-ad1c4c902a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.690760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cb071-b1e1-4eeb-ae8b-ad1c4c902a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.691731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cb071-b1e1-4eeb-ae8b-ad1c4c902a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.693370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cb071-b1e1-4eeb-ae8b-ad1c4c902a52 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.704429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 790/1589] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:23.706834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cb071-b1e1-4eeb-ae8b-ad1c4c902a52 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.715965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cb071-b1e1-4eeb-ae8b-ad1c4c902a52 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.720433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c15b4d-2ff7-4931-9ae8-3aba0f66b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.721009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15b4d-2ff7-4931-9ae8-3aba0f66b733 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.721343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15b4d-2ff7-4931-9ae8-3aba0f66b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.721473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6e10-9546-4fd7-a1db-bd3a9c9f369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.721596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15b4d-2ff7-4931-9ae8-3aba0f66b733 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.722003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6e10-9546-4fd7-a1db-bd3a9c9f369d admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.722148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c15b4d-2ff7-4931-9ae8-3aba0f66b733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.722272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6e10-9546-4fd7-a1db-bd3a9c9f369d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.722540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6e10-9546-4fd7-a1db-bd3a9c9f369d admin admin] PATH_INFO: `/v3/projects/4afdccd180414fdda741ce40a31a4e79/users/8664800c0aa84cd5a69ea97ed3fa9756/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.724057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c15b4d-2ff7-4931-9ae8-3aba0f66b733 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.738020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db6e10-9546-4fd7-a1db-bd3a9c9f369d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4afdccd180414fdda741ce40a31a4e79, user_id=8664800c0aa84cd5a69ea97ed3fa9756, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.739109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-e5db6e10-9546-4fd7-a1db-bd3a9c9f369d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:31:23.739109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: warnings.warn(msg) Sep 02 09:31:23.739109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: Sep 02 09:31:23.741357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db6e10-9546-4fd7-a1db-bd3a9c9f369d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.869753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 800/1590] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:23 2022] PUT /identity/v3/projects/4afdccd180414fdda741ce40a31a4e79/users/8664800c0aa84cd5a69ea97ed3fa9756/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:23.870222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 791/1591] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:23 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:23.870819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6e10-9546-4fd7-a1db-bd3a9c9f369d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.871114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c15b4d-2ff7-4931-9ae8-3aba0f66b733 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.881380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c15b4d-2ff7-4931-9ae8-3aba0f66b733 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.940563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6e10-9546-4fd7-a1db-bd3a9c9f369d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.944012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250848e-1f5c-447f-8c92-74abe3d0db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.944624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250848e-1f5c-447f-8c92-74abe3d0db0d admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.944929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250848e-1f5c-447f-8c92-74abe3d0db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.945122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139a971-67ca-4a7b-9df0-0674604545a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.945251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250848e-1f5c-447f-8c92-74abe3d0db0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.945721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139a971-67ca-4a7b-9df0-0674604545a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.945850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250848e-1f5c-447f-8c92-74abe3d0db0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.945999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139a971-67ca-4a7b-9df0-0674604545a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.946264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139a971-67ca-4a7b-9df0-0674604545a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.946888 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139a971-67ca-4a7b-9df0-0674604545a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.947479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250848e-1f5c-447f-8c92-74abe3d0db0d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.948557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139a971-67ca-4a7b-9df0-0674604545a0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.961001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 792/1592] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:23.961210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 801/1593] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:23.961304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a3867-ac07-4c16-9b97-7e2583230406 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.961387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139a971-67ca-4a7b-9df0-0674604545a0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.961495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a3867-ac07-4c16-9b97-7e2583230406 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.961495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a3867-ac07-4c16-9b97-7e2583230406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.970340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139a971-67ca-4a7b-9df0-0674604545a0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:23.975065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aa336-493f-4cf8-9d01-ebf66776c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:23.975643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aa336-493f-4cf8-9d01-ebf66776c648 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:23.976476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aa336-493f-4cf8-9d01-ebf66776c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:23.976857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aa336-493f-4cf8-9d01-ebf66776c648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:23.977518 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9aa336-493f-4cf8-9d01-ebf66776c648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:23.979152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9aa336-493f-4cf8-9d01-ebf66776c648 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:23.987271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-793a3867-ac07-4c16-9b97-7e2583230406 None None] MFA Rules not processed for user `cd42744b0c4b4bed8f4e59af3aeab96f`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:23.988531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-793a3867-ac07-4c16-9b97-7e2583230406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:23.988779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 802/1594] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:23.989633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aa336-493f-4cf8-9d01-ebf66776c648 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:23.993559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:23.996472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:24.000102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aa336-493f-4cf8-9d01-ebf66776c648 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.004682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e15512-9f6d-40da-bd6f-7cb2638dc3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.009550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e15512-9f6d-40da-bd6f-7cb2638dc3fa admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.009550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e15512-9f6d-40da-bd6f-7cb2638dc3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.009550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e15512-9f6d-40da-bd6f-7cb2638dc3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.009550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e15512-9f6d-40da-bd6f-7cb2638dc3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.009550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e15512-9f6d-40da-bd6f-7cb2638dc3fa admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.019282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 803/1595] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:24.020573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30ae9-eb41-4ada-b0ac-bc41eaf26576 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.020853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30ae9-eb41-4ada-b0ac-bc41eaf26576 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.021121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30ae9-eb41-4ada-b0ac-bc41eaf26576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.040042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-82f30ae9-eb41-4ada-b0ac-bc41eaf26576 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:24.041228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-82f30ae9-eb41-4ada-b0ac-bc41eaf26576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:24.051912 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 804/1596] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:24.051912 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f30ae9-eb41-4ada-b0ac-bc41eaf26576 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.059992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 793/1597] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:24.060855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a3867-ac07-4c16-9b97-7e2583230406 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.062788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f30ae9-eb41-4ada-b0ac-bc41eaf26576 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.068788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67952e4f-96e9-4769-a759-6ac0829b2963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.069398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67952e4f-96e9-4769-a759-6ac0829b2963 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.069691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67952e4f-96e9-4769-a759-6ac0829b2963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.069967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67952e4f-96e9-4769-a759-6ac0829b2963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.070607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67952e4f-96e9-4769-a759-6ac0829b2963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.071180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a3867-ac07-4c16-9b97-7e2583230406 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.072256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67952e4f-96e9-4769-a759-6ac0829b2963 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.076592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18630e9-420c-42aa-9114-cdec8fd33774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.077994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18630e9-420c-42aa-9114-cdec8fd33774 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.078142 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18630e9-420c-42aa-9114-cdec8fd33774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.078417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18630e9-420c-42aa-9114-cdec8fd33774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.079347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18630e9-420c-42aa-9114-cdec8fd33774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.080972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18630e9-420c-42aa-9114-cdec8fd33774 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.086296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 805/1598] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:24.086296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67952e4f-96e9-4769-a759-6ac0829b2963 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.094497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67952e4f-96e9-4769-a759-6ac0829b2963 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.097912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 794/1599] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:24.098986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18630e9-420c-42aa-9114-cdec8fd33774 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.099526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d4079-786a-4170-bd1f-8cc8a2051ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.100199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d4079-786a-4170-bd1f-8cc8a2051ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.100477 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d4079-786a-4170-bd1f-8cc8a2051ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.101643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d4079-786a-4170-bd1f-8cc8a2051ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.102210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d4079-786a-4170-bd1f-8cc8a2051ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.103796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d4079-786a-4170-bd1f-8cc8a2051ec4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.109532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18630e9-420c-42aa-9114-cdec8fd33774 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.117236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892f2a3-65dc-4a35-9c14-d28112669595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.117236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892f2a3-65dc-4a35-9c14-d28112669595 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.117236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892f2a3-65dc-4a35-9c14-d28112669595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.117236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892f2a3-65dc-4a35-9c14-d28112669595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.117673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892f2a3-65dc-4a35-9c14-d28112669595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.117765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 806/1600] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:24.117765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d4079-786a-4170-bd1f-8cc8a2051ec4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.117939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892f2a3-65dc-4a35-9c14-d28112669595 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.127092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d4079-786a-4170-bd1f-8cc8a2051ec4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.128390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 795/1601] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:24.129626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892f2a3-65dc-4a35-9c14-d28112669595 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.131844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adbf21-ca0a-46dd-9898-d85f4af6435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.132546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adbf21-ca0a-46dd-9898-d85f4af6435b admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.132828 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adbf21-ca0a-46dd-9898-d85f4af6435b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.133104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adbf21-ca0a-46dd-9898-d85f4af6435b admin admin] PATH_INFO: `/v3/projects/6a5598aa12a94f59b84e8263ccc4405b/users/74da492996c945f2aa0f801fb4a3518e/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.147603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adbf21-ca0a-46dd-9898-d85f4af6435b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5598aa12a94f59b84e8263ccc4405b, user_id=74da492996c945f2aa0f801fb4a3518e, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.152693 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adbf21-ca0a-46dd-9898-d85f4af6435b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.185141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892f2a3-65dc-4a35-9c14-d28112669595 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.188873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6f614-a016-4e35-b9e0-8d15059954da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.189474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6f614-a016-4e35-b9e0-8d15059954da service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.189749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6f614-a016-4e35-b9e0-8d15059954da service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.190021 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6f614-a016-4e35-b9e0-8d15059954da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.199225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6f614-a016-4e35-b9e0-8d15059954da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.204237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6f614-a016-4e35-b9e0-8d15059954da service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.210813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 796/1602] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:24.211609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6f614-a016-4e35-b9e0-8d15059954da service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.220276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6f614-a016-4e35-b9e0-8d15059954da service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.224883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232be8f-01ee-49da-869f-9bb0bf6d6bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.225517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232be8f-01ee-49da-869f-9bb0bf6d6bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.225737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232be8f-01ee-49da-869f-9bb0bf6d6bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.226094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232be8f-01ee-49da-869f-9bb0bf6d6bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.227576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232be8f-01ee-49da-869f-9bb0bf6d6bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.229335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232be8f-01ee-49da-869f-9bb0bf6d6bbd admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.246445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 807/1603] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:24 2022] PUT /identity/v3/projects/6a5598aa12a94f59b84e8263ccc4405b/users/74da492996c945f2aa0f801fb4a3518e/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:24.246445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608bed3-f5bb-4446-b5b6-e87399b5ba42 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.246445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608bed3-f5bb-4446-b5b6-e87399b5ba42 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.246445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608bed3-f5bb-4446-b5b6-e87399b5ba42 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.246445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 808/1604] 10.222.0.55 () {54 vars in 962 bytes} [Fri Sep 2 09:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:31:24.246445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608bed3-f5bb-4446-b5b6-e87399b5ba42 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.247404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 797/1605] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:24.247404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232be8f-01ee-49da-869f-9bb0bf6d6bbd admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.250688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232be8f-01ee-49da-869f-9bb0bf6d6bbd admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.309407 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608bed3-f5bb-4446-b5b6-e87399b5ba42 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.311158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f4afb-04fa-41e9-a912-a713b8223109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.311908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f4afb-04fa-41e9-a912-a713b8223109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.312278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f4afb-04fa-41e9-a912-a713b8223109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.312611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f4afb-04fa-41e9-a912-a713b8223109 admin admin] PATH_INFO: `/v3/projects/062a6b7dc303452ca29e9fbe73c764fd/users/9e747ea5426946829252525f26eff612/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.314448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa79299-99da-478c-96ca-aa0fbdf92b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.315101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa79299-99da-478c-96ca-aa0fbdf92b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.315403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa79299-99da-478c-96ca-aa0fbdf92b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.315675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa79299-99da-478c-96ca-aa0fbdf92b18 admin admin] PATH_INFO: `/v3/projects/07e98d12a75249e7ae05d6e9cdc5bdd7/users/8bd18df842724159869f630f96229758/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.331058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f4afb-04fa-41e9-a912-a713b8223109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062a6b7dc303452ca29e9fbe73c764fd, user_id=9e747ea5426946829252525f26eff612, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.333649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f4afb-04fa-41e9-a912-a713b8223109 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.334809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa79299-99da-478c-96ca-aa0fbdf92b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e98d12a75249e7ae05d6e9cdc5bdd7, user_id=8bd18df842724159869f630f96229758, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.338334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa79299-99da-478c-96ca-aa0fbdf92b18 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.441256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:24.446969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 809/1606] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:24 2022] PUT /identity/v3/projects/07e98d12a75249e7ae05d6e9cdc5bdd7/users/8bd18df842724159869f630f96229758/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:24.456192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa79299-99da-478c-96ca-aa0fbdf92b18 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.456332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 798/1607] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:24 2022] PUT /identity/v3/projects/062a6b7dc303452ca29e9fbe73c764fd/users/9e747ea5426946829252525f26eff612/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:24.456332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f4afb-04fa-41e9-a912-a713b8223109 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.524060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa79299-99da-478c-96ca-aa0fbdf92b18 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.526620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f4afb-04fa-41e9-a912-a713b8223109 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.530234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b2bbb-ab02-4315-9f15-e8e9f6095b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.530982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b2bbb-ab02-4315-9f15-e8e9f6095b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.531332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b2bbb-ab02-4315-9f15-e8e9f6095b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.532108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b2bbb-ab02-4315-9f15-e8e9f6095b2f admin admin] PATH_INFO: `/v3/projects/8600c7f983464790bd62b515d487ce76/users/702b8f59f5d348acb1263f058aed84a2/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.532904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa2534-e22f-4fec-915c-7b9e5270e23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.533651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa2534-e22f-4fec-915c-7b9e5270e23b admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.534092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa2534-e22f-4fec-915c-7b9e5270e23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.534448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa2534-e22f-4fec-915c-7b9e5270e23b admin admin] PATH_INFO: `/v3/projects/3e8f00d9ff52437facea6edfde4920e0/users/233ccfdda18d43f7b1fd585ca74037f8/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.550784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b2bbb-ab02-4315-9f15-e8e9f6095b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8600c7f983464790bd62b515d487ce76, user_id=702b8f59f5d348acb1263f058aed84a2, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.553891 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa2534-e22f-4fec-915c-7b9e5270e23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8f00d9ff52437facea6edfde4920e0, user_id=233ccfdda18d43f7b1fd585ca74037f8, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:24.554018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b2bbb-ab02-4315-9f15-e8e9f6095b2f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.558550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa2534-e22f-4fec-915c-7b9e5270e23b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:24.629169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 799/1608] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:24 2022] PUT /identity/v3/projects/3e8f00d9ff52437facea6edfde4920e0/users/233ccfdda18d43f7b1fd585ca74037f8/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:24.630926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c53bf-3910-447e-a378-bf39d095e076 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.631406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c53bf-3910-447e-a378-bf39d095e076 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.631737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c53bf-3910-447e-a378-bf39d095e076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.633894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 810/1609] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:24 2022] PUT /identity/v3/projects/8600c7f983464790bd62b515d487ce76/users/702b8f59f5d348acb1263f058aed84a2/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:24.635225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ecf7c-e3a7-4bfe-90c9-20ee0b17e63e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.635515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ecf7c-e3a7-4bfe-90c9-20ee0b17e63e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.635794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ecf7c-e3a7-4bfe-90c9-20ee0b17e63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.649424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:24.664638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1e4ecf7c-e3a7-4bfe-90c9-20ee0b17e63e None None] MFA Rules not processed for user `74da492996c945f2aa0f801fb4a3518e`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:24.665929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1e4ecf7c-e3a7-4bfe-90c9-20ee0b17e63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:24.679799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4d1c53bf-3910-447e-a378-bf39d095e076 None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:24.681164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4d1c53bf-3910-447e-a378-bf39d095e076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:24.748635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 811/1610] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:24.750892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3b364-b97f-4947-9d9e-7cebb27bf11a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.751173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3b364-b97f-4947-9d9e-7cebb27bf11a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.751443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3b364-b97f-4947-9d9e-7cebb27bf11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.784738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 800/1611] 10.222.0.55 () {58 vars in 1059 bytes} [Fri Sep 2 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:24.786502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cff60-1d08-413f-afc4-25c770be78c2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.787180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cff60-1d08-413f-afc4-25c770be78c2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.788548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cff60-1d08-413f-afc4-25c770be78c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.796604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-00c3b364-b97f-4947-9d9e-7cebb27bf11a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:24.798019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-00c3b364-b97f-4947-9d9e-7cebb27bf11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:24.837389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-fa0cff60-1d08-413f-afc4-25c770be78c2 None None] MFA Rules not processed for user `9e747ea5426946829252525f26eff612`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:24.838617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fa0cff60-1d08-413f-afc4-25c770be78c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:24.880038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 812/1612] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:24.881574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb63717-f390-4c80-9227-a22984d88cbf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.881858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb63717-f390-4c80-9227-a22984d88cbf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.882134 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb63717-f390-4c80-9227-a22984d88cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.904960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-abb63717-f390-4c80-9227-a22984d88cbf None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:24.905227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:24.906411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-abb63717-f390-4c80-9227-a22984d88cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:24.919460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 813/1613] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:24.920831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23cc28-583a-4325-90e9-7d69b9c5a33a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.921143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23cc28-583a-4325-90e9-7d69b9c5a33a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.921413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23cc28-583a-4325-90e9-7d69b9c5a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.931747 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 801/1614] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:24.935211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432ae0-af1f-4826-80c2-a1066421b065 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.935211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432ae0-af1f-4826-80c2-a1066421b065 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.935211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432ae0-af1f-4826-80c2-a1066421b065 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.935211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 802/1615] 10.222.0.55 () {54 vars in 962 bytes} [Fri Sep 2 09:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:31:24.940525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432ae0-af1f-4826-80c2-a1066421b065 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.954892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-dd23cc28-583a-4325-90e9-7d69b9c5a33a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:24.956632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432ae0-af1f-4826-80c2-a1066421b065 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:24.962839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dd23cc28-583a-4325-90e9-7d69b9c5a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:24.963827 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f95d7-1a81-423b-99a8-77f80f8222d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:24.964628 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f95d7-1a81-423b-99a8-77f80f8222d5 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:24.965057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f95d7-1a81-423b-99a8-77f80f8222d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:24.965564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f95d7-1a81-423b-99a8-77f80f8222d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:24.971764 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 814/1616] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:24.980583 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23cc28-583a-4325-90e9-7d69b9c5a33a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:24.980583 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dd23cc28-583a-4325-90e9-7d69b9c5a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:25.031229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f95d7-1a81-423b-99a8-77f80f8222d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.037002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f95d7-1a81-423b-99a8-77f80f8222d5 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.045704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 803/1617] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:25.046929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f95d7-1a81-423b-99a8-77f80f8222d5 service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.048454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-829f95d7-1a81-423b-99a8-77f80f8222d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:25.071174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23cc28-583a-4325-90e9-7d69b9c5a33a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.074940 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730524-58ba-47ce-b41a-56c4be0f64c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.075562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730524-58ba-47ce-b41a-56c4be0f64c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.075836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730524-58ba-47ce-b41a-56c4be0f64c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.076911 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730524-58ba-47ce-b41a-56c4be0f64c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.094315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7730524-58ba-47ce-b41a-56c4be0f64c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.095948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7730524-58ba-47ce-b41a-56c4be0f64c5 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.111313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 815/1618] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:25.112284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730524-58ba-47ce-b41a-56c4be0f64c5 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.127329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f95d7-1a81-423b-99a8-77f80f8222d5 service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.127684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85024996-db5b-4e64-8530-6410d383e12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.127844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730524-58ba-47ce-b41a-56c4be0f64c5 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.128619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85024996-db5b-4e64-8530-6410d383e12d service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.129117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85024996-db5b-4e64-8530-6410d383e12d service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.129488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85024996-db5b-4e64-8530-6410d383e12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.133758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626aa5f-68f5-4a7a-babb-cbad1ece51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.134365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626aa5f-68f5-4a7a-babb-cbad1ece51b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.135282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626aa5f-68f5-4a7a-babb-cbad1ece51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.135612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626aa5f-68f5-4a7a-babb-cbad1ece51b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.136305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626aa5f-68f5-4a7a-babb-cbad1ece51b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.138806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626aa5f-68f5-4a7a-babb-cbad1ece51b9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.144351 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85024996-db5b-4e64-8530-6410d383e12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.145944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85024996-db5b-4e64-8530-6410d383e12d service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.160978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 804/1619] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:25.171642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df86c9-e261-42d4-959c-6a17145813fa None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.174931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df86c9-e261-42d4-959c-6a17145813fa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.174931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df86c9-e261-42d4-959c-6a17145813fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.208239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-45df86c9-e261-42d4-959c-6a17145813fa None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:25.211069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-45df86c9-e261-42d4-959c-6a17145813fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:25.225952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 805/1620] 10.222.0.55 () {58 vars in 1059 bytes} [Fri Sep 2 09:31:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:25.227079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df86c9-e261-42d4-959c-6a17145813fa None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.237596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df86c9-e261-42d4-959c-6a17145813fa None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.241893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5f251-fcc9-4521-9d3a-f0d29600f769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.242506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5f251-fcc9-4521-9d3a-f0d29600f769 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.242777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5f251-fcc9-4521-9d3a-f0d29600f769 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.243202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5f251-fcc9-4521-9d3a-f0d29600f769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.278386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5f251-fcc9-4521-9d3a-f0d29600f769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.279026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5f251-fcc9-4521-9d3a-f0d29600f769 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.288881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 816/1621] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:25 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:25.289914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626aa5f-68f5-4a7a-babb-cbad1ece51b9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.296687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 806/1622] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:25.298057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5f251-fcc9-4521-9d3a-f0d29600f769 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.308363 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:25.315405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5f251-fcc9-4521-9d3a-f0d29600f769 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.388326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626aa5f-68f5-4a7a-babb-cbad1ece51b9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.389261 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd926c-f361-4394-a85e-f12e73548b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.389925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd926c-f361-4394-a85e-f12e73548b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.390200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd926c-f361-4394-a85e-f12e73548b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.390526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd926c-f361-4394-a85e-f12e73548b54 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.391352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd926c-f361-4394-a85e-f12e73548b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.393446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd926c-f361-4394-a85e-f12e73548b54 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.396154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c5aa9-a3e6-42b0-a3b2-792ae0e8fe30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.396796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c5aa9-a3e6-42b0-a3b2-792ae0e8fe30 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.397065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c5aa9-a3e6-42b0-a3b2-792ae0e8fe30 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.397417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c5aa9-a3e6-42b0-a3b2-792ae0e8fe30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.465717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:25.474398 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 807/1623] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:25 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:25.475823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5946-d26f-4795-aba9-fa715808e268 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.476615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5946-d26f-4795-aba9-fa715808e268 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.476928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5946-d26f-4795-aba9-fa715808e268 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.478751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 808/1624] 10.222.0.55 () {54 vars in 912 bytes} [Fri Sep 2 09:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:31:25.479095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5946-d26f-4795-aba9-fa715808e268 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.497361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5946-d26f-4795-aba9-fa715808e268 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.531354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c5aa9-a3e6-42b0-a3b2-792ae0e8fe30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.537149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd172-c061-4c0c-95f4-78929fb8e5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.537873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd172-c061-4c0c-95f4-78929fb8e5ea admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.537979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c5aa9-a3e6-42b0-a3b2-792ae0e8fe30 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.538220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd172-c061-4c0c-95f4-78929fb8e5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.538907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd172-c061-4c0c-95f4-78929fb8e5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.539430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcd172-c061-4c0c-95f4-78929fb8e5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.541306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcd172-c061-4c0c-95f4-78929fb8e5ea admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.556919 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 817/1625] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:25.557835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 809/1626] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:25.558465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba04b-3e18-4a75-8d12-609ae8fbd863 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.558747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba04b-3e18-4a75-8d12-609ae8fbd863 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.559019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba04b-3e18-4a75-8d12-609ae8fbd863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.561404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd172-c061-4c0c-95f4-78929fb8e5ea admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.578864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd172-c061-4c0c-95f4-78929fb8e5ea admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.585143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4823a0-9103-4457-8269-765e33f8f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.586378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4823a0-9103-4457-8269-765e33f8f661 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.586864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4823a0-9103-4457-8269-765e33f8f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.587332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4823a0-9103-4457-8269-765e33f8f661 admin admin] PATH_INFO: `/v3/projects/db94e12aacb74c26a5f67d4fb1d59842/users/98e0b3837a474c54b1b31b5cb1a1f91f/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.606032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-876ba04b-3e18-4a75-8d12-609ae8fbd863 None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:25.608637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-876ba04b-3e18-4a75-8d12-609ae8fbd863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:25.612837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4823a0-9103-4457-8269-765e33f8f661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db94e12aacb74c26a5f67d4fb1d59842, user_id=98e0b3837a474c54b1b31b5cb1a1f91f, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.615837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4823a0-9103-4457-8269-765e33f8f661 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.625325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 818/1627] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:31:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:25.627175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25942-bd69-4c00-9c3c-d5accfbc07c4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.627599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25942-bd69-4c00-9c3c-d5accfbc07c4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.628126 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25942-bd69-4c00-9c3c-d5accfbc07c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.668719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-73f25942-bd69-4c00-9c3c-d5accfbc07c4 None None] MFA Rules not processed for user `8664800c0aa84cd5a69ea97ed3fa9756`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:25.670696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-73f25942-bd69-4c00-9c3c-d5accfbc07c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:25.715145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 810/1628] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:25 2022] PUT /identity/v3/projects/db94e12aacb74c26a5f67d4fb1d59842/users/98e0b3837a474c54b1b31b5cb1a1f91f/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:25.717641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4823a0-9103-4457-8269-765e33f8f661 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.803582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4823a0-9103-4457-8269-765e33f8f661 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.811415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a73e10-cb3d-44d5-86c4-35a3775ec032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.811415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a73e10-cb3d-44d5-86c4-35a3775ec032 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.811415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a73e10-cb3d-44d5-86c4-35a3775ec032 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.811415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a73e10-cb3d-44d5-86c4-35a3775ec032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.814577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 819/1629] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:25.816040 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f25942-bd69-4c00-9c3c-d5accfbc07c4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.833688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f25942-bd69-4c00-9c3c-d5accfbc07c4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.875972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:25.935349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a73e10-cb3d-44d5-86c4-35a3775ec032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.936843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a73e10-cb3d-44d5-86c4-35a3775ec032 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.937753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655fb6b-3cd6-4be7-8cec-e20f46303011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.938370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655fb6b-3cd6-4be7-8cec-e20f46303011 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.938643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655fb6b-3cd6-4be7-8cec-e20f46303011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.938907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655fb6b-3cd6-4be7-8cec-e20f46303011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.939548 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655fb6b-3cd6-4be7-8cec-e20f46303011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.941247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655fb6b-3cd6-4be7-8cec-e20f46303011 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:25.955763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 820/1630] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:25.955763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655fb6b-3cd6-4be7-8cec-e20f46303011 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.964169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 811/1631] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:25.965423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655fb6b-3cd6-4be7-8cec-e20f46303011 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:25.966434 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cdbc7-48c9-4889-99ee-d9e59cbb2dc1 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.966738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cdbc7-48c9-4889-99ee-d9e59cbb2dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.967021 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cdbc7-48c9-4889-99ee-d9e59cbb2dc1 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.972043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 812/1632] 10.222.0.55 () {54 vars in 912 bytes} [Fri Sep 2 09:31:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:31:25.975580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa6fac-bdf3-4cad-9883-619085865f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:25.975580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6fac-bdf3-4cad-9883-619085865f7d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:25.975580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6fac-bdf3-4cad-9883-619085865f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:25.975580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6fac-bdf3-4cad-9883-619085865f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:25.976911 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa6fac-bdf3-4cad-9883-619085865f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:25.977014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cdbc7-48c9-4889-99ee-d9e59cbb2dc1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:25.978888 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa6fac-bdf3-4cad-9883-619085865f7d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:26.004663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cdbc7-48c9-4889-99ee-d9e59cbb2dc1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:26.014709 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d5e60-61b8-45de-9de6-a84f12f10917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:26.015379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d5e60-61b8-45de-9de6-a84f12f10917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:26.015650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d5e60-61b8-45de-9de6-a84f12f10917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:26.015942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d5e60-61b8-45de-9de6-a84f12f10917 admin admin] PATH_INFO: `/v3/projects/db94e12aacb74c26a5f67d4fb1d59842/users/98e0b3837a474c54b1b31b5cb1a1f91f/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:26.017901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d5e60-61b8-45de-9de6-a84f12f10917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db94e12aacb74c26a5f67d4fb1d59842, user_id=98e0b3837a474c54b1b31b5cb1a1f91f, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:26.021074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d5e60-61b8-45de-9de6-a84f12f10917 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:26.057822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 813/1633] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:25 2022] PUT /identity/v3/projects/db94e12aacb74c26a5f67d4fb1d59842/users/98e0b3837a474c54b1b31b5cb1a1f91f/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:26.060138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a170b10-116f-4c0c-b51e-503f5312f5f0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:26.061217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a170b10-116f-4c0c-b51e-503f5312f5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:26.061498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a170b10-116f-4c0c-b51e-503f5312f5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:26.098576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1a170b10-116f-4c0c-b51e-503f5312f5f0 None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:26.099854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1a170b10-116f-4c0c-b51e-503f5312f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:26.151161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 821/1634] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:25 2022] POST /identity/v3/projects => generated 403 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:26.155391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a97bcd-0a2f-4410-8379-9dea67b1d990 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:26.155703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a97bcd-0a2f-4410-8379-9dea67b1d990 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:26.155973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a97bcd-0a2f-4410-8379-9dea67b1d990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:26.192620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:26.205045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-79a97bcd-0a2f-4410-8379-9dea67b1d990 None None] MFA Rules not processed for user `98e0b3837a474c54b1b31b5cb1a1f91f`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:26.206346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-79a97bcd-0a2f-4410-8379-9dea67b1d990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:26.221434 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 814/1635] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:31:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:26.222383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a170b10-116f-4c0c-b51e-503f5312f5f0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:26.303429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a170b10-116f-4c0c-b51e-503f5312f5f0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:26.322895 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 822/1636] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:26.324804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a97bcd-0a2f-4410-8379-9dea67b1d990 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:26.372705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6f3a9-2656-468d-be0b-b64d561e84df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:26.373321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6f3a9-2656-468d-be0b-b64d561e84df admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:26.373625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6f3a9-2656-468d-be0b-b64d561e84df admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:26.373895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6f3a9-2656-468d-be0b-b64d561e84df admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:26.374524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6f3a9-2656-468d-be0b-b64d561e84df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:26.376821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6f3a9-2656-468d-be0b-b64d561e84df admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:26.396025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a97bcd-0a2f-4410-8379-9dea67b1d990 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:26.401494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252dd39-eb66-4820-a2de-1b8372a18da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:26.402113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252dd39-eb66-4820-a2de-1b8372a18da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:26.402387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252dd39-eb66-4820-a2de-1b8372a18da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:26.402725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252dd39-eb66-4820-a2de-1b8372a18da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:26.459455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:26.491310 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 815/1637] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:26 2022] POST /identity/v3/users => generated 308 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:26.495453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6f3a9-2656-468d-be0b-b64d561e84df admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:26.514285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6f3a9-2656-468d-be0b-b64d561e84df admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:26.520039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d76107-ef2c-4c07-9cde-c87e93b5b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:26.520753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d76107-ef2c-4c07-9cde-c87e93b5b064 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:26.520938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d76107-ef2c-4c07-9cde-c87e93b5b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:26.521553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d76107-ef2c-4c07-9cde-c87e93b5b064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:26.522107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d76107-ef2c-4c07-9cde-c87e93b5b064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:26.525253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252dd39-eb66-4820-a2de-1b8372a18da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:26.527442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252dd39-eb66-4820-a2de-1b8372a18da2 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:26.539511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d76107-ef2c-4c07-9cde-c87e93b5b064 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:26.557734 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 823/1638] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:26.570708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 816/1639] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:31:26.571857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252dd39-eb66-4820-a2de-1b8372a18da2 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:26.583642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252dd39-eb66-4820-a2de-1b8372a18da2 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:26.589018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039093a1-59ca-4e9f-bb70-084eeaa0af3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:26.589691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039093a1-59ca-4e9f-bb70-084eeaa0af3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:26.590633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039093a1-59ca-4e9f-bb70-084eeaa0af3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:26.590633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039093a1-59ca-4e9f-bb70-084eeaa0af3b admin admin] PATH_INFO: `/v3/projects/218e5606691749f5a92f3eee8a896ce9/users/6f06045e35bb48ddbec20834e1aa5832/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:26.610122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039093a1-59ca-4e9f-bb70-084eeaa0af3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=218e5606691749f5a92f3eee8a896ce9, user_id=6f06045e35bb48ddbec20834e1aa5832, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:26.618961 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039093a1-59ca-4e9f-bb70-084eeaa0af3b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:26.699584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 824/1640] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:26 2022] PUT /identity/v3/projects/218e5606691749f5a92f3eee8a896ce9/users/6f06045e35bb48ddbec20834e1aa5832/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:31:26.703482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d76107-ef2c-4c07-9cde-c87e93b5b064 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:26.716799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d76107-ef2c-4c07-9cde-c87e93b5b064 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:26.753341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039093a1-59ca-4e9f-bb70-084eeaa0af3b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:26.858931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039093a1-59ca-4e9f-bb70-084eeaa0af3b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:26.863775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acbf80-94a6-44d2-861c-6a7632ac5a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:26.864491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acbf80-94a6-44d2-861c-6a7632ac5a18 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:26.864622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819bdb-123b-40a5-ac18-d3cbf45ac1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:26.864827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acbf80-94a6-44d2-861c-6a7632ac5a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:26.865031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acbf80-94a6-44d2-861c-6a7632ac5a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:26.865225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819bdb-123b-40a5-ac18-d3cbf45ac1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:26.865590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819bdb-123b-40a5-ac18-d3cbf45ac1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:26.865781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819bdb-123b-40a5-ac18-d3cbf45ac1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:26.867134 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819bdb-123b-40a5-ac18-d3cbf45ac1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:26.868763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819bdb-123b-40a5-ac18-d3cbf45ac1c8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:26.895419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 817/1641] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:26.899643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819bdb-123b-40a5-ac18-d3cbf45ac1c8 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:26.921336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819bdb-123b-40a5-ac18-d3cbf45ac1c8 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:26.934255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536b55e-20c3-4ad6-a1ae-ef48aa4f647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:26.935482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536b55e-20c3-4ad6-a1ae-ef48aa4f647a admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:26.936991 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536b55e-20c3-4ad6-a1ae-ef48aa4f647a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:26.937299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536b55e-20c3-4ad6-a1ae-ef48aa4f647a admin admin] PATH_INFO: `/v3/projects/218e5606691749f5a92f3eee8a896ce9/users/6f06045e35bb48ddbec20834e1aa5832/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:26.941606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536b55e-20c3-4ad6-a1ae-ef48aa4f647a admin admin] RBAC: Authorizing `identity:create_grant(project_id=218e5606691749f5a92f3eee8a896ce9, user_id=6f06045e35bb48ddbec20834e1aa5832, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:26.944495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536b55e-20c3-4ad6-a1ae-ef48aa4f647a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:26.966489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 818/1642] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:26 2022] PUT /identity/v3/projects/218e5606691749f5a92f3eee8a896ce9/users/6f06045e35bb48ddbec20834e1aa5832/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:26.979228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acbf80-94a6-44d2-861c-6a7632ac5a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:26.980772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acbf80-94a6-44d2-861c-6a7632ac5a18 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:26.990945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 825/1643] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:31:27.292927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:28.949748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536b55e-20c3-4ad6-a1ae-ef48aa4f647a admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:29.107332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536b55e-20c3-4ad6-a1ae-ef48aa4f647a admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:29.126308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a52be-e185-4eae-8ae4-9ec0ac0e55fa None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:29.126308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a52be-e185-4eae-8ae4-9ec0ac0e55fa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:29.126825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a52be-e185-4eae-8ae4-9ec0ac0e55fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:29.139093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:29.143318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:29.143318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:29.143318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] PATH_INFO: `/v3/users/9e747ea5426946829252525f26eff612` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:29.145766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e747ea5426946829252525f26eff612)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:29.147801 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:29.200604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0b5a52be-e185-4eae-8ae4-9ec0ac0e55fa None None] MFA Rules not processed for user `6f06045e35bb48ddbec20834e1aa5832`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:29.206161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0b5a52be-e185-4eae-8ae4-9ec0ac0e55fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:29.290219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:29.341733 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 826/1644] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:29 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:29.412254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e747ea5426946829252525f26eff612'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:29.414795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e747ea5426946829252525f26eff612'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:29.458042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e747ea5426946829252525f26eff612'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:29.468092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e747ea5426946829252525f26eff612'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:29.586739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e747ea5426946829252525f26eff612'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:29.620798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 819/1645] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:28 2022] DELETE /identity/v3/users/9e747ea5426946829252525f26eff612 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:29.625730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d60e7-69d6-42fd-9360-27954e2239cf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:29.627678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d60e7-69d6-42fd-9360-27954e2239cf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:29.628491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d60e7-69d6-42fd-9360-27954e2239cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:29.673785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-815d60e7-69d6-42fd-9360-27954e2239cf None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:29.677229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-815d60e7-69d6-42fd-9360-27954e2239cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:29.794423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 827/1646] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:29.807348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:29.809559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:29.932825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b907b6-a480-4771-a9e6-0b7f48b6c74d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:29.938450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a7d97-818f-48d1-8f6b-885faef875b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:29.939077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a7d97-818f-48d1-8f6b-885faef875b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:29.939366 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a7d97-818f-48d1-8f6b-885faef875b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:29.939643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a7d97-818f-48d1-8f6b-885faef875b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:29.956700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a7d97-818f-48d1-8f6b-885faef875b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:29.961547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a7d97-818f-48d1-8f6b-885faef875b6 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:29.985099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 820/1647] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:30.646978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d60e7-69d6-42fd-9360-27954e2239cf None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:30.649228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-815d60e7-69d6-42fd-9360-27954e2239cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:30.677732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d60e7-69d6-42fd-9360-27954e2239cf None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:30.695860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:30.696671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:30.696958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:30.702431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] PATH_INFO: `/v3/users/74da492996c945f2aa0f801fb4a3518e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:30.703412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74da492996c945f2aa0f801fb4a3518e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:30.704556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:31:30.704556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: warnings.warn(msg) Sep 02 09:31:30.704556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: Sep 02 09:31:30.708815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:31.078857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74da492996c945f2aa0f801fb4a3518e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:31.170371 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74da492996c945f2aa0f801fb4a3518e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:31.199831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74da492996c945f2aa0f801fb4a3518e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:31.200788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74da492996c945f2aa0f801fb4a3518e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:31.244018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74da492996c945f2aa0f801fb4a3518e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:31.265869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 828/1648] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:30 2022] DELETE /identity/v3/users/74da492996c945f2aa0f801fb4a3518e => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:31.270289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549dcf8-8998-4b3d-b13d-83f2c397369e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:31.270788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549dcf8-8998-4b3d-b13d-83f2c397369e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:31.271065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549dcf8-8998-4b3d-b13d-83f2c397369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:31.298647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d549dcf8-8998-4b3d-b13d-83f2c397369e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:31.299873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d549dcf8-8998-4b3d-b13d-83f2c397369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:31.312106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:31.373838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 821/1649] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:31.392895 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:31.397558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:31.482811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:31.494357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e081c08-a775-4dce-8e8f-9dcf32699415 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:31.498896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00b3a8-4aa1-4bb6-b624-2f586f361a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:31.499739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00b3a8-4aa1-4bb6-b624-2f586f361a6c service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:31.500180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00b3a8-4aa1-4bb6-b624-2f586f361a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:31.500589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00b3a8-4aa1-4bb6-b624-2f586f361a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:31.515835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00b3a8-4aa1-4bb6-b624-2f586f361a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:31.519159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00b3a8-4aa1-4bb6-b624-2f586f361a6c service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:31.544968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 829/1650] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:31.857188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eed771-b1a9-4874-8076-15904fdd5554 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:31.857643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eed771-b1a9-4874-8076-15904fdd5554 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:31.858005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eed771-b1a9-4874-8076-15904fdd5554 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:31.859831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 822/1651] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:31:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:31:31.990453 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74845cfe-8826-4942-b04f-706b093720b1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:31.991038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74845cfe-8826-4942-b04f-706b093720b1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:31.991038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74845cfe-8826-4942-b04f-706b093720b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:32.045174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-74845cfe-8826-4942-b04f-706b093720b1 None None] MFA Rules not processed for user `d1d19d1439914eac9993bf31fa4c9384`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:32.046469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-74845cfe-8826-4942-b04f-706b093720b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:32.149651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eed771-b1a9-4874-8076-15904fdd5554 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:32.151377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-28eed771-b1a9-4874-8076-15904fdd5554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:32.195912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eed771-b1a9-4874-8076-15904fdd5554 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:32.215641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:32.216331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:32.216613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:32.217026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] PATH_INFO: `/v3/projects/062a6b7dc303452ca29e9fbe73c764fd` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:32.218389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062a6b7dc303452ca29e9fbe73c764fd)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:32.219787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: WARNING py.warnings [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 09:31:32.219787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: warnings.warn(msg) Sep 02 09:31:32.219787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: Sep 02 09:31:32.230088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:32.240285 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 830/1652] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:31:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:32.305855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74845cfe-8826-4942-b04f-706b093720b1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:32.308126 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-74845cfe-8826-4942-b04f-706b093720b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:32.346659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74845cfe-8826-4942-b04f-706b093720b1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:32.400423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062a6b7dc303452ca29e9fbe73c764fd', 'request_id': 'req-a10b201c-f712-4285-906a-0ed97df839d9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:32.433166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062a6b7dc303452ca29e9fbe73c764fd', 'request_id': 'req-a10b201c-f712-4285-906a-0ed97df839d9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:32.506012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062a6b7dc303452ca29e9fbe73c764fd', 'request_id': 'req-a10b201c-f712-4285-906a-0ed97df839d9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:32.555497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe727b-600d-42c3-b73a-9b60d22aae8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:32.556160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe727b-600d-42c3-b73a-9b60d22aae8f service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:32.556446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe727b-600d-42c3-b73a-9b60d22aae8f service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:32.557011 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe727b-600d-42c3-b73a-9b60d22aae8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:32.585608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe727b-600d-42c3-b73a-9b60d22aae8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:32.585608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe727b-600d-42c3-b73a-9b60d22aae8f service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:32.614087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 831/1653] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:32.634821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] The token cache is being invalidate because project 062a6b7dc303452ca29e9fbe73c764fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:32.635210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:32.636331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:32.638019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 823/1654] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:32 2022] DELETE /identity/v3/projects/062a6b7dc303452ca29e9fbe73c764fd => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:31:32.643172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe727b-600d-42c3-b73a-9b60d22aae8f service placement] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:32.806201 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe727b-600d-42c3-b73a-9b60d22aae8f service placement] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:32.817028 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:32.818239 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:32.818862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:32.820318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] PATH_INFO: `/v3/users/98e0b3837a474c54b1b31b5cb1a1f91f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:32.822009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e0b3837a474c54b1b31b5cb1a1f91f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:32.826778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:33.079678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e0b3837a474c54b1b31b5cb1a1f91f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:33.177587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e0b3837a474c54b1b31b5cb1a1f91f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:33.186704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e0b3837a474c54b1b31b5cb1a1f91f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:33.187997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e0b3837a474c54b1b31b5cb1a1f91f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:33.237377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e0b3837a474c54b1b31b5cb1a1f91f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:33.252065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 832/1655] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:32 2022] DELETE /identity/v3/users/98e0b3837a474c54b1b31b5cb1a1f91f => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:33.384747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:33.566282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:33.568629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:33.593497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b201c-f712-4285-906a-0ed97df839d9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:33.725962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:33.726629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:33.726912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:33.727191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] PATH_INFO: `/v3/projects/6a5598aa12a94f59b84e8263ccc4405b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:33.731254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5598aa12a94f59b84e8263ccc4405b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:33.733245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:33.885422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:33.888840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:33.922872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bf80-df96-491b-a4ee-0f6b127a69e6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:33.938111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:33.938111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:33.940705 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:33.941132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] PATH_INFO: `/v3/users/8664800c0aa84cd5a69ea97ed3fa9756` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:33.942894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8664800c0aa84cd5a69ea97ed3fa9756)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:33.946203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:33.981300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:33.990362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5598aa12a94f59b84e8263ccc4405b', 'request_id': 'req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.022387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5598aa12a94f59b84e8263ccc4405b', 'request_id': 'req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.032981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5598aa12a94f59b84e8263ccc4405b', 'request_id': 'req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.143939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] The token cache is being invalidate because project 6a5598aa12a94f59b84e8263ccc4405b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:34.145682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.145682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.153633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 824/1656] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:33 2022] DELETE /identity/v3/projects/6a5598aa12a94f59b84e8263ccc4405b => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:34.154659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:34.160583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:34.246476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8664800c0aa84cd5a69ea97ed3fa9756'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.295743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45b2d2-9505-4d4d-a38e-54c0054ab00d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:34.305158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:34.308131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:34.308735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:34.309885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] PATH_INFO: `/v3/users/cd42744b0c4b4bed8f4e59af3aeab96f` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:34.313069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd42744b0c4b4bed8f4e59af3aeab96f)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:34.317905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:34.347819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8664800c0aa84cd5a69ea97ed3fa9756'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.357186 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8664800c0aa84cd5a69ea97ed3fa9756'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.360219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8664800c0aa84cd5a69ea97ed3fa9756'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.397717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-030ff9b3-562d-4c74-8d61-62e12f25ca03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8664800c0aa84cd5a69ea97ed3fa9756'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.407618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 833/1657] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:33 2022] DELETE /identity/v3/users/8664800c0aa84cd5a69ea97ed3fa9756 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:34.409736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55e6f9-0582-4b2c-a8e5-e8f6d754c4b1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:34.410044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55e6f9-0582-4b2c-a8e5-e8f6d754c4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:34.410340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55e6f9-0582-4b2c-a8e5-e8f6d754c4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:34.434360 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-df55e6f9-0582-4b2c-a8e5-e8f6d754c4b1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:34.435751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-df55e6f9-0582-4b2c-a8e5-e8f6d754c4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:34.510369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 834/1658] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:34.519779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0577f5-4397-4cb9-a955-9664d0d9e4ca None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:34.520110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0577f5-4397-4cb9-a955-9664d0d9e4ca None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:34.520320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0577f5-4397-4cb9-a955-9664d0d9e4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:34.548681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ad0577f5-4397-4cb9-a955-9664d0d9e4ca None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:34.550192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ad0577f5-4397-4cb9-a955-9664d0d9e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:34.567934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 835/1659] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:34.569964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0577f5-4397-4cb9-a955-9664d0d9e4ca None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:34.584254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0577f5-4397-4cb9-a955-9664d0d9e4ca None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:34.591994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a309a6-f7ca-4621-8919-1b69aa3a7d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:34.593369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a309a6-f7ca-4621-8919-1b69aa3a7d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:34.593675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a309a6-f7ca-4621-8919-1b69aa3a7d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:34.594013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a309a6-f7ca-4621-8919-1b69aa3a7d2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:34.594903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a309a6-f7ca-4621-8919-1b69aa3a7d2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:34.595258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a309a6-f7ca-4621-8919-1b69aa3a7d2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:34.597142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a309a6-f7ca-4621-8919-1b69aa3a7d2f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:34.615315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 836/1660] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:34.621813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a309a6-f7ca-4621-8919-1b69aa3a7d2f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:34.636684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a309a6-f7ca-4621-8919-1b69aa3a7d2f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:34.644500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4813149-1760-4e08-afee-eba6ae008f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:34.645463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813149-1760-4e08-afee-eba6ae008f30 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:34.645852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813149-1760-4e08-afee-eba6ae008f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:34.646229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813149-1760-4e08-afee-eba6ae008f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:34.647070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4813149-1760-4e08-afee-eba6ae008f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:34.652065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4813149-1760-4e08-afee-eba6ae008f30 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:34.657419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd42744b0c4b4bed8f4e59af3aeab96f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.661478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd42744b0c4b4bed8f4e59af3aeab96f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.701037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd42744b0c4b4bed8f4e59af3aeab96f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.719396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd42744b0c4b4bed8f4e59af3aeab96f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.818080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 837/1661] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:34.822923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4813149-1760-4e08-afee-eba6ae008f30 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:34.836363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ecc371e5-599a-40b3-a93c-e931b21f137e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd42744b0c4b4bed8f4e59af3aeab96f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:34.845037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 825/1662] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:34 2022] DELETE /identity/v3/users/cd42744b0c4b4bed8f4e59af3aeab96f => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:34.845762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:34.851933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6774cff-6b1a-4465-961f-bee8d1797df5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:34.852219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6774cff-6b1a-4465-961f-bee8d1797df5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:34.852496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6774cff-6b1a-4465-961f-bee8d1797df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:34.898825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e6774cff-6b1a-4465-961f-bee8d1797df5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:34.903094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e6774cff-6b1a-4465-961f-bee8d1797df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:34.987264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4813149-1760-4e08-afee-eba6ae008f30 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:35.062399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 826/1663] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:31:35.076878 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6774cff-6b1a-4465-961f-bee8d1797df5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:35.079589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e6774cff-6b1a-4465-961f-bee8d1797df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:35.151407 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44dd8a-f14a-42e5-8c09-6f8e0f8c2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:35.152676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44dd8a-f14a-42e5-8c09-6f8e0f8c2c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:35.154068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44dd8a-f14a-42e5-8c09-6f8e0f8c2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:35.154924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44dd8a-f14a-42e5-8c09-6f8e0f8c2c9c admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:35.155865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44dd8a-f14a-42e5-8c09-6f8e0f8c2c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:35.161411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44dd8a-f14a-42e5-8c09-6f8e0f8c2c9c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:35.243918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6774cff-6b1a-4465-961f-bee8d1797df5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:35.255105 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f83ffd-afbf-448d-a938-892698f95d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:35.256366 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83ffd-afbf-448d-a938-892698f95d1c service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:35.258200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83ffd-afbf-448d-a938-892698f95d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:35.259480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83ffd-afbf-448d-a938-892698f95d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:35.269345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 838/1664] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:34 2022] POST /identity/v3/users => generated 287 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:35.269887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44dd8a-f14a-42e5-8c09-6f8e0f8c2c9c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:35.273944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0c44dd8a-f14a-42e5-8c09-6f8e0f8c2c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:35.295980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f83ffd-afbf-448d-a938-892698f95d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:35.298236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f83ffd-afbf-448d-a938-892698f95d1c service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:35.300710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44dd8a-f14a-42e5-8c09-6f8e0f8c2c9c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:35.312984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed40132-d183-431a-960b-b8a8ba242b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:35.313807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed40132-d183-431a-960b-b8a8ba242b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:35.315052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed40132-d183-431a-960b-b8a8ba242b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:35.315457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed40132-d183-431a-960b-b8a8ba242b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:35.316798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed40132-d183-431a-960b-b8a8ba242b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:35.319290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 827/1665] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:35.320962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed40132-d183-431a-960b-b8a8ba242b7c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:35.346866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 839/1666] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:35.347939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f83ffd-afbf-448d-a938-892698f95d1c service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:35.366046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f83ffd-afbf-448d-a938-892698f95d1c service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:35.376693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bd2fa-4396-4553-baa4-393398de6af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:35.377463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd2fa-4396-4553-baa4-393398de6af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:35.377747 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd2fa-4396-4553-baa4-393398de6af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:35.378075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd2fa-4396-4553-baa4-393398de6af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:35.378773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd2fa-4396-4553-baa4-393398de6af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:35.380605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd2fa-4396-4553-baa4-393398de6af9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:35.394057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 828/1667] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:35.400963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed40132-d183-431a-960b-b8a8ba242b7c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:35.415684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed40132-d183-431a-960b-b8a8ba242b7c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:35.421247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12db38d-10d1-429e-9ec5-33519466a7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:35.422021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12db38d-10d1-429e-9ec5-33519466a7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:35.422307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12db38d-10d1-429e-9ec5-33519466a7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:35.422635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12db38d-10d1-429e-9ec5-33519466a7e0 admin admin] PATH_INFO: `/v3/projects/e7609757e24243e4968f5ad674027bd7/users/17a7ce72dfab46a9a5c98213a2da1661/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:35.454676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12db38d-10d1-429e-9ec5-33519466a7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7609757e24243e4968f5ad674027bd7, user_id=17a7ce72dfab46a9a5c98213a2da1661, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:35.459419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12db38d-10d1-429e-9ec5-33519466a7e0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:35.578272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 840/1668] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:35 2022] PUT /identity/v3/projects/e7609757e24243e4968f5ad674027bd7/users/17a7ce72dfab46a9a5c98213a2da1661/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:35.582838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3dfe-7e94-4dc0-8930-0d29e5c58618 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:35.583694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3dfe-7e94-4dc0-8930-0d29e5c58618 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:35.584452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3dfe-7e94-4dc0-8930-0d29e5c58618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:35.631232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-700e3dfe-7e94-4dc0-8930-0d29e5c58618 None None] MFA Rules not processed for user `17a7ce72dfab46a9a5c98213a2da1661`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:35.633541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-700e3dfe-7e94-4dc0-8930-0d29e5c58618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:35.659177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12db38d-10d1-429e-9ec5-33519466a7e0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:35.661512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f12db38d-10d1-429e-9ec5-33519466a7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:35.878645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 829/1669] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:35.885289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e3dfe-7e94-4dc0-8930-0d29e5c58618 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:35.887980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-700e3dfe-7e94-4dc0-8930-0d29e5c58618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:35.897193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12db38d-10d1-429e-9ec5-33519466a7e0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:35.926015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:35.928551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:35.929668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:35.930624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] PATH_INFO: `/v3/projects/4afdccd180414fdda741ce40a31a4e79` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:35.934908 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4afdccd180414fdda741ce40a31a4e79)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:35.943237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:36.114052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e3dfe-7e94-4dc0-8930-0d29e5c58618 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:36.124470 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4afdccd180414fdda741ce40a31a4e79', 'request_id': 'req-c1359079-021c-4e74-bb3f-1e95adb4d266'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:36.134020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4afdccd180414fdda741ce40a31a4e79', 'request_id': 'req-c1359079-021c-4e74-bb3f-1e95adb4d266'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:36.155869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:36.163896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4afdccd180414fdda741ce40a31a4e79', 'request_id': 'req-c1359079-021c-4e74-bb3f-1e95adb4d266'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:36.244450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ebca4-35bc-401a-aa90-9c8f57a006cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:36.246603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ebca4-35bc-401a-aa90-9c8f57a006cd service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:36.247038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ebca4-35bc-401a-aa90-9c8f57a006cd service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:36.247437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ebca4-35bc-401a-aa90-9c8f57a006cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:36.305000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] The token cache is being invalidate because project 4afdccd180414fdda741ce40a31a4e79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:36.306327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:36.326684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ebca4-35bc-401a-aa90-9c8f57a006cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:36.327312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ebca4-35bc-401a-aa90-9c8f57a006cd service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:36.336551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:36.339863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 830/1670] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:36.341603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ebca4-35bc-401a-aa90-9c8f57a006cd service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:36.343441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5f1ebca4-35bc-401a-aa90-9c8f57a006cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:36.365058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 841/1671] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:35 2022] DELETE /identity/v3/projects/4afdccd180414fdda741ce40a31a4e79 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:36.367604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:36.378135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:36.485724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ebca4-35bc-401a-aa90-9c8f57a006cd service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:36.504818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:36.505910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:36.506401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:36.506757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] PATH_INFO: `/v3/projects/db94e12aacb74c26a5f67d4fb1d59842` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:36.509697 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db94e12aacb74c26a5f67d4fb1d59842)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:36.513987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:36.688795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1359079-021c-4e74-bb3f-1e95adb4d266 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:36.705372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db94e12aacb74c26a5f67d4fb1d59842', 'request_id': 'req-260262f5-71eb-4460-b821-ca5a84e02e99'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:36.723125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db94e12aacb74c26a5f67d4fb1d59842', 'request_id': 'req-260262f5-71eb-4460-b821-ca5a84e02e99'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:36.768911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db94e12aacb74c26a5f67d4fb1d59842', 'request_id': 'req-260262f5-71eb-4460-b821-ca5a84e02e99'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:36.846597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:36.847343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:36.847719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:36.848065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] PATH_INFO: `/v3/users/6f06045e35bb48ddbec20834e1aa5832` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:36.849488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f06045e35bb48ddbec20834e1aa5832)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:36.852246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:36.906802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] The token cache is being invalidate because project db94e12aacb74c26a5f67d4fb1d59842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:36.907432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:36.909051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:36.910991 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 831/1672] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:36 2022] DELETE /identity/v3/projects/db94e12aacb74c26a5f67d4fb1d59842 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:36.911804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:36.917881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:36.958199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260262f5-71eb-4460-b821-ca5a84e02e99 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:36.970849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:36.971754 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:36.972318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:36.972733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] PATH_INFO: `/v3/users/17a7ce72dfab46a9a5c98213a2da1661` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:36.974642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a7ce72dfab46a9a5c98213a2da1661)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:36.979166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:37.075103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f06045e35bb48ddbec20834e1aa5832'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.179084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f06045e35bb48ddbec20834e1aa5832'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.196563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f06045e35bb48ddbec20834e1aa5832'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.197420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f06045e35bb48ddbec20834e1aa5832'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.217475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a7ce72dfab46a9a5c98213a2da1661'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.220596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a7ce72dfab46a9a5c98213a2da1661'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.235455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8393aebb-15bd-4f1a-8198-6cecc958165a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f06045e35bb48ddbec20834e1aa5832'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.258380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 842/1673] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:36 2022] DELETE /identity/v3/users/6f06045e35bb48ddbec20834e1aa5832 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:37.260031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bd7cd-5ab3-4bd9-b5c0-4c8104e4d737 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:37.260279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bd7cd-5ab3-4bd9-b5c0-4c8104e4d737 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:37.260548 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bd7cd-5ab3-4bd9-b5c0-4c8104e4d737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:37.273732 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a7ce72dfab46a9a5c98213a2da1661'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.286805 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a7ce72dfab46a9a5c98213a2da1661'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.316616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8f4bd7cd-5ab3-4bd9-b5c0-4c8104e4d737 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:37.317876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8f4bd7cd-5ab3-4bd9-b5c0-4c8104e4d737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:37.355280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:37.383865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a7ce72dfab46a9a5c98213a2da1661'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.395050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 832/1674] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:36 2022] DELETE /identity/v3/users/17a7ce72dfab46a9a5c98213a2da1661 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:37.396047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:37.400940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:37.484497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 843/1675] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:37.485871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0d444-002b-4fae-aded-979de8fb1542 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:37.486158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0d444-002b-4fae-aded-979de8fb1542 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:37.486431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0d444-002b-4fae-aded-979de8fb1542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:37.523719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-27e0d444-002b-4fae-aded-979de8fb1542 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:37.526909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-27e0d444-002b-4fae-aded-979de8fb1542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:37.562087 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135311ef-64b9-449d-9ab6-4ea71a72c44a admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:37.578453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:37.579167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:37.579557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:37.579838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] PATH_INFO: `/v3/projects/c1194ac266234e87a976710aad254782` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:37.584853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1194ac266234e87a976710aad254782)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:37.585946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:37.678235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 844/1676] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:37.680190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cb60f-cfdc-45d2-882c-b877d7318722 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:37.680472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cb60f-cfdc-45d2-882c-b877d7318722 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:37.680740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cb60f-cfdc-45d2-882c-b877d7318722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:37.713385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e72cb60f-cfdc-45d2-882c-b877d7318722 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:37.716015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e72cb60f-cfdc-45d2-882c-b877d7318722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:37.744787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1194ac266234e87a976710aad254782', 'request_id': 'req-320ecd6f-713e-4452-8c65-de4b57afb4e4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.755814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1194ac266234e87a976710aad254782', 'request_id': 'req-320ecd6f-713e-4452-8c65-de4b57afb4e4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.769926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1194ac266234e87a976710aad254782', 'request_id': 'req-320ecd6f-713e-4452-8c65-de4b57afb4e4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.856693 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 845/1677] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:37.858006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cb60f-cfdc-45d2-882c-b877d7318722 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:37.859732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e72cb60f-cfdc-45d2-882c-b877d7318722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:37.879616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] The token cache is being invalidate because project c1194ac266234e87a976710aad254782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:37.880328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.882887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:37.885313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 833/1678] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:37 2022] DELETE /identity/v3/projects/c1194ac266234e87a976710aad254782 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:37.886524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:37.888833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:37.927543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ecd6f-713e-4452-8c65-de4b57afb4e4 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:37.939135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b68fa-eb26-4379-8d15-218ad8319416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:37.941610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b68fa-eb26-4379-8d15-218ad8319416 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:37.941893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b68fa-eb26-4379-8d15-218ad8319416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:37.942885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b68fa-eb26-4379-8d15-218ad8319416 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:37.945314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b68fa-eb26-4379-8d15-218ad8319416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:37.945878 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b68fa-eb26-4379-8d15-218ad8319416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:37.952542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b68fa-eb26-4379-8d15-218ad8319416 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:37.996100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 834/1679] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:37.997732 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0f56-3906-44cc-9e32-88c0ddd352ec None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:37.998960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0f56-3906-44cc-9e32-88c0ddd352ec None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:38.000802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0f56-3906-44cc-9e32-88c0ddd352ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:38.030755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cb60f-cfdc-45d2-882c-b877d7318722 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:38.042465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1141e9-40d4-47ae-8d57-8721e6f0d15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:38.043269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1141e9-40d4-47ae-8d57-8721e6f0d15b service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:38.043618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1141e9-40d4-47ae-8d57-8721e6f0d15b service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:38.044087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1141e9-40d4-47ae-8d57-8721e6f0d15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:38.055797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3a1141e9-40d4-47ae-8d57-8721e6f0d15b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:38.059689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f92f0f56-3906-44cc-9e32-88c0ddd352ec None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:38.060921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f92f0f56-3906-44cc-9e32-88c0ddd352ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:38.084913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1141e9-40d4-47ae-8d57-8721e6f0d15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:38.086641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1141e9-40d4-47ae-8d57-8721e6f0d15b service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:38.088735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 835/1680] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:38.098680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f0f56-3906-44cc-9e32-88c0ddd352ec None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:38.113989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 846/1681] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:38.115899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7403-ddb5-43ef-9e57-4f137eb1684b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:38.117720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7403-ddb5-43ef-9e57-4f137eb1684b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:38.118217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7403-ddb5-43ef-9e57-4f137eb1684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:38.123111 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f0f56-3906-44cc-9e32-88c0ddd352ec None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:38.160310 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381828b-2bdf-4fc6-aab4-5d467bb00355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:38.161414 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381828b-2bdf-4fc6-aab4-5d467bb00355 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:38.161761 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381828b-2bdf-4fc6-aab4-5d467bb00355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:38.162102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381828b-2bdf-4fc6-aab4-5d467bb00355 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:38.165457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381828b-2bdf-4fc6-aab4-5d467bb00355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:38.166888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381828b-2bdf-4fc6-aab4-5d467bb00355 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:38.190556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-19cb7403-ddb5-43ef-9e57-4f137eb1684b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:38.190556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-19cb7403-ddb5-43ef-9e57-4f137eb1684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:38.213600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:38.224778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 847/1682] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:38.226234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7403-ddb5-43ef-9e57-4f137eb1684b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:38.229952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-19cb7403-ddb5-43ef-9e57-4f137eb1684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:38.265471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7403-ddb5-43ef-9e57-4f137eb1684b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:38.277564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:38.278315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:38.278485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:38.278758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] PATH_INFO: `/v3/users/fe36f8324ca446b0acf3cc339c2f38eb` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:38.284754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe36f8324ca446b0acf3cc339c2f38eb)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:38.288154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:38.302354 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 836/1683] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:38 2022] POST /identity/v3/projects => generated 357 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:38.303367 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381828b-2bdf-4fc6-aab4-5d467bb00355 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:38.452032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:38.466200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381828b-2bdf-4fc6-aab4-5d467bb00355 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:38.479485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8f63-eefd-4b79-9cf1-6e9944d6cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:38.480521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8f63-eefd-4b79-9cf1-6e9944d6cafa admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:38.480997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8f63-eefd-4b79-9cf1-6e9944d6cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:38.481409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8f63-eefd-4b79-9cf1-6e9944d6cafa admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:38.483200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8f63-eefd-4b79-9cf1-6e9944d6cafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:38.483678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8f63-eefd-4b79-9cf1-6e9944d6cafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:38.487609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8f63-eefd-4b79-9cf1-6e9944d6cafa admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:38.505585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 837/1684] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:38.508495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8f63-eefd-4b79-9cf1-6e9944d6cafa admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:38.523117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8f63-eefd-4b79-9cf1-6e9944d6cafa admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:38.540265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521751e3-a090-4879-8b1b-4a613012661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:38.543133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521751e3-a090-4879-8b1b-4a613012661f admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:38.543133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521751e3-a090-4879-8b1b-4a613012661f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:38.543133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521751e3-a090-4879-8b1b-4a613012661f admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:38.543133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521751e3-a090-4879-8b1b-4a613012661f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:38.546600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521751e3-a090-4879-8b1b-4a613012661f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:38.552548 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe36f8324ca446b0acf3cc339c2f38eb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:38.657448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe36f8324ca446b0acf3cc339c2f38eb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:38.674609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 838/1685] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:38 2022] POST /identity/v3/users => generated 279 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:38.674609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521751e3-a090-4879-8b1b-4a613012661f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:38.677689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe36f8324ca446b0acf3cc339c2f38eb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:38.678729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe36f8324ca446b0acf3cc339c2f38eb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:38.696409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521751e3-a090-4879-8b1b-4a613012661f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:38.704598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe36f8324ca446b0acf3cc339c2f38eb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:38.706714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51af18f-d8d0-42e0-a991-993f0356f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:38.708578 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af18f-d8d0-42e0-a991-993f0356f8be admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:38.708857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af18f-d8d0-42e0-a991-993f0356f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:38.709338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af18f-d8d0-42e0-a991-993f0356f8be admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:38.712134 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51af18f-d8d0-42e0-a991-993f0356f8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:38.712918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51af18f-d8d0-42e0-a991-993f0356f8be admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:38.727763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 848/1686] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:38 2022] DELETE /identity/v3/users/fe36f8324ca446b0acf3cc339c2f38eb => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:38.728477 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:38.729954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:38.796372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:38.860146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 839/1687] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:38 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:38.863022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51af18f-d8d0-42e0-a991-993f0356f8be admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:38.880793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a51af18f-d8d0-42e0-a991-993f0356f8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:38.891138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501513a-beff-4a34-b089-5bd350dbd876 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:39.038514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:39.039182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.039448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.044306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] PATH_INFO: `/v3/projects/218e5606691749f5a92f3eee8a896ce9` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.046365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=218e5606691749f5a92f3eee8a896ce9)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:39.049333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:39.089521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51af18f-d8d0-42e0-a991-993f0356f8be admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:39.104039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e04d37-2cce-4981-b327-9f2821bfe333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:39.106521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04d37-2cce-4981-b327-9f2821bfe333 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.106521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04d37-2cce-4981-b327-9f2821bfe333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.119294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04d37-2cce-4981-b327-9f2821bfe333 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.121106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e04d37-2cce-4981-b327-9f2821bfe333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:39.124406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e04d37-2cce-4981-b327-9f2821bfe333 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:39.141507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 840/1688] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:39.143762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a72fb-8a1d-4457-a92b-74939351727c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.144268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a72fb-8a1d-4457-a92b-74939351727c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.144706 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a72fb-8a1d-4457-a92b-74939351727c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.193904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5a0a72fb-8a1d-4457-a92b-74939351727c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:39.198063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5a0a72fb-8a1d-4457-a92b-74939351727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:39.236025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218e5606691749f5a92f3eee8a896ce9', 'request_id': 'req-d6d459e7-52ee-4c4e-84fa-db990afef235'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:39.242255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218e5606691749f5a92f3eee8a896ce9', 'request_id': 'req-d6d459e7-52ee-4c4e-84fa-db990afef235'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:39.258734 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218e5606691749f5a92f3eee8a896ce9', 'request_id': 'req-d6d459e7-52ee-4c4e-84fa-db990afef235'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:39.358058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] The token cache is being invalidate because project 218e5606691749f5a92f3eee8a896ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:39.358683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:39.360022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:39.362824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 849/1689] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:38 2022] DELETE /identity/v3/projects/218e5606691749f5a92f3eee8a896ce9 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:39.368851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:39.375100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:39.401403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 841/1690] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:39.406060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f55774-262d-4e0d-a1a6-ad461298a8de None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.406492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f55774-262d-4e0d-a1a6-ad461298a8de None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.406774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f55774-262d-4e0d-a1a6-ad461298a8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.436986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d459e7-52ee-4c4e-84fa-db990afef235 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:39.447591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a183b-0ba0-47c0-9889-b2176c4b4852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:39.450980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a183b-0ba0-47c0-9889-b2176c4b4852 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.451507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a183b-0ba0-47c0-9889-b2176c4b4852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.452014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a183b-0ba0-47c0-9889-b2176c4b4852 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.453379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a183b-0ba0-47c0-9889-b2176c4b4852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:39.461467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a183b-0ba0-47c0-9889-b2176c4b4852 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:39.480971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-23f55774-262d-4e0d-a1a6-ad461298a8de None None] MFA Rules not processed for user `702b8f59f5d348acb1263f058aed84a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:39.482937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-23f55774-262d-4e0d-a1a6-ad461298a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:39.576590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 850/1691] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:39 2022] POST /identity/v3/users => generated 282 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:39.579870 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7596c-ac4f-4f8e-946c-1d1f37654959 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.579999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7596c-ac4f-4f8e-946c-1d1f37654959 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.581752 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7596c-ac4f-4f8e-946c-1d1f37654959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.605575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 842/1692] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:39.607103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f55774-262d-4e0d-a1a6-ad461298a8de None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:39.612134 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-23f55774-262d-4e0d-a1a6-ad461298a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:39.641288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f55774-262d-4e0d-a1a6-ad461298a8de None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:39.642811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-20c7596c-ac4f-4f8e-946c-1d1f37654959 None None] MFA Rules not processed for user `8bd18df842724159869f630f96229758`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:39.644156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-20c7596c-ac4f-4f8e-946c-1d1f37654959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:39.650360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503453b3-711b-4e11-aa6d-ff452c9701c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:39.651218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503453b3-711b-4e11-aa6d-ff452c9701c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.651597 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503453b3-711b-4e11-aa6d-ff452c9701c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.652015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503453b3-711b-4e11-aa6d-ff452c9701c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.652800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503453b3-711b-4e11-aa6d-ff452c9701c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:39.654738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503453b3-711b-4e11-aa6d-ff452c9701c3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:39.678016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 843/1693] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:39.678016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbccd3c-8846-4d5c-bd68-473c339821c9 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.678016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbccd3c-8846-4d5c-bd68-473c339821c9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.678016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbccd3c-8846-4d5c-bd68-473c339821c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.725210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-9bbccd3c-8846-4d5c-bd68-473c339821c9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:39.730838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9bbccd3c-8846-4d5c-bd68-473c339821c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:39.737844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 851/1694] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:39.738803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7596c-ac4f-4f8e-946c-1d1f37654959 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:39.740860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-20c7596c-ac4f-4f8e-946c-1d1f37654959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:39.758905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 844/1695] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:39.759955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbccd3c-8846-4d5c-bd68-473c339821c9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:39.770770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbccd3c-8846-4d5c-bd68-473c339821c9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:39.776417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a0b4-c81b-47ca-8230-29e098511a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:39.777132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a0b4-c81b-47ca-8230-29e098511a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.777595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a0b4-c81b-47ca-8230-29e098511a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.778564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a0b4-c81b-47ca-8230-29e098511a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.781821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a0b4-c81b-47ca-8230-29e098511a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:39.784300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a0b4-c81b-47ca-8230-29e098511a2e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:39.801837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 845/1696] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:39.803137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a0b4-c81b-47ca-8230-29e098511a2e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:39.806110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0d68a0b4-c81b-47ca-8230-29e098511a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:39.823953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7596c-ac4f-4f8e-946c-1d1f37654959 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:39.828526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad12ffd-32b7-4efd-a125-a01b540bdb7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:39.829751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12ffd-32b7-4efd-a125-a01b540bdb7c service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.830056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12ffd-32b7-4efd-a125-a01b540bdb7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.830423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12ffd-32b7-4efd-a125-a01b540bdb7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.858184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad12ffd-32b7-4efd-a125-a01b540bdb7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:39.858358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:39.863430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad12ffd-32b7-4efd-a125-a01b540bdb7c service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:39.901817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 852/1697] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:39.903215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad12ffd-32b7-4efd-a125-a01b540bdb7c service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:39.928367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad12ffd-32b7-4efd-a125-a01b540bdb7c service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:39.933914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff4dea-4f62-493d-9587-1006ac719f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:39.935203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4dea-4f62-493d-9587-1006ac719f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:39.935629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4dea-4f62-493d-9587-1006ac719f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:39.936274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4dea-4f62-493d-9587-1006ac719f1f admin admin] PATH_INFO: `/v3/projects/487b8c75d056488583a7c2b13bc2529f/users/35693d7d24534da39a027b6e3ce0e96a/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:39.970207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff4dea-4f62-493d-9587-1006ac719f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=487b8c75d056488583a7c2b13bc2529f, user_id=35693d7d24534da39a027b6e3ce0e96a, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:39.974608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff4dea-4f62-493d-9587-1006ac719f1f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:39.989573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a0b4-c81b-47ca-8230-29e098511a2e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:39.996889 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdd30f-b4d1-426f-9082-3745dcf7e31a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:39.997692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdd30f-b4d1-426f-9082-3745dcf7e31a service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.002848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdd30f-b4d1-426f-9082-3745dcf7e31a service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.002848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdd30f-b4d1-426f-9082-3745dcf7e31a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.009555 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdd30f-b4d1-426f-9082-3745dcf7e31a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:40.011352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdd30f-b4d1-426f-9082-3745dcf7e31a service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:40.024508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 846/1698] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:40.026153 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d387cb-151a-4ed2-a24c-97e298070ff9 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.026444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d387cb-151a-4ed2-a24c-97e298070ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.026718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d387cb-151a-4ed2-a24c-97e298070ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.052966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 853/1699] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:39 2022] PUT /identity/v3/projects/487b8c75d056488583a7c2b13bc2529f/users/35693d7d24534da39a027b6e3ce0e96a/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:40.063131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c29a8-735f-4875-b811-49d5a4980636 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.063421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c29a8-735f-4875-b811-49d5a4980636 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.063702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c29a8-735f-4875-b811-49d5a4980636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.072432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-74d387cb-151a-4ed2-a24c-97e298070ff9 None None] MFA Rules not processed for user `8bd18df842724159869f630f96229758`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:40.074556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-74d387cb-151a-4ed2-a24c-97e298070ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:40.092389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-899c29a8-735f-4875-b811-49d5a4980636 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:40.093816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-899c29a8-735f-4875-b811-49d5a4980636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:40.212369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:40.222846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 847/1700] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:40.222846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d387cb-151a-4ed2-a24c-97e298070ff9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:40.242091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 854/1701] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:40.244155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c29a8-735f-4875-b811-49d5a4980636 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:40.251494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-899c29a8-735f-4875-b811-49d5a4980636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:40.285910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c29a8-735f-4875-b811-49d5a4980636 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:40.286059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:40.286660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.287146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.287420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] PATH_INFO: `/v3/projects/e7609757e24243e4968f5ad674027bd7` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.289075 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7609757e24243e4968f5ad674027bd7)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:40.292540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:40.364347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d387cb-151a-4ed2-a24c-97e298070ff9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:40.372015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9fc8-1ce8-4231-bfe3-2cb9b74cb77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:40.373479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9fc8-1ce8-4231-bfe3-2cb9b74cb77e admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.374276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9fc8-1ce8-4231-bfe3-2cb9b74cb77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.374609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9fc8-1ce8-4231-bfe3-2cb9b74cb77e admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.378263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9fc8-1ce8-4231-bfe3-2cb9b74cb77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:40.380063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9fc8-1ce8-4231-bfe3-2cb9b74cb77e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:40.394556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 848/1702] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:40.397329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ab8bd-bc83-4034-a460-22e41f22c7f3 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.397329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ab8bd-bc83-4034-a460-22e41f22c7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.398450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ab8bd-bc83-4034-a460-22e41f22c7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.443069 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7609757e24243e4968f5ad674027bd7', 'request_id': 'req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:40.451454 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7609757e24243e4968f5ad674027bd7', 'request_id': 'req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:40.459518 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7609757e24243e4968f5ad674027bd7', 'request_id': 'req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:40.469323 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4d3ab8bd-bc83-4034-a460-22e41f22c7f3 None None] MFA Rules not processed for user `233ccfdda18d43f7b1fd585ca74037f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:40.470801 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4d3ab8bd-bc83-4034-a460-22e41f22c7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:40.546093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] The token cache is being invalidate because project e7609757e24243e4968f5ad674027bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:40.546093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:40.546458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9785f303-9a72-4c2a-9b2b-9370dd1ef09d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:40.548450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 855/1703] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:40 2022] DELETE /identity/v3/projects/e7609757e24243e4968f5ad674027bd7 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:40.549498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc1a1b-e820-4f4d-b833-baa9ad3f2d6f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.549781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc1a1b-e820-4f4d-b833-baa9ad3f2d6f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.550060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc1a1b-e820-4f4d-b833-baa9ad3f2d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.563823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 849/1704] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:40.563823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ab8bd-bc83-4034-a460-22e41f22c7f3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:40.563823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4d3ab8bd-bc83-4034-a460-22e41f22c7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:40.610877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a2cc1a1b-e820-4f4d-b833-baa9ad3f2d6f None None] MFA Rules not processed for user `35693d7d24534da39a027b6e3ce0e96a`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:40.612999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a2cc1a1b-e820-4f4d-b833-baa9ad3f2d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:40.690746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ab8bd-bc83-4034-a460-22e41f22c7f3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:40.697791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6089f27-5656-4863-9952-06ac765cb277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:40.698411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6089f27-5656-4863-9952-06ac765cb277 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.698743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6089f27-5656-4863-9952-06ac765cb277 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.699027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6089f27-5656-4863-9952-06ac765cb277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.700996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c6089f27-5656-4863-9952-06ac765cb277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:40.720629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 856/1705] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:40.720629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc1a1b-e820-4f4d-b833-baa9ad3f2d6f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:40.722203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a2cc1a1b-e820-4f4d-b833-baa9ad3f2d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:40.818536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6089f27-5656-4863-9952-06ac765cb277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:40.818735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc1a1b-e820-4f4d-b833-baa9ad3f2d6f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:40.820508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6089f27-5656-4863-9952-06ac765cb277 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:40.830050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0a8cd-f8ca-4b2a-a504-e9cd3bf97485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:40.830050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0a8cd-f8ca-4b2a-a504-e9cd3bf97485 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.830050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0a8cd-f8ca-4b2a-a504-e9cd3bf97485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.830050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0a8cd-f8ca-4b2a-a504-e9cd3bf97485 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.830426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0a8cd-f8ca-4b2a-a504-e9cd3bf97485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:40.830426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0a8cd-f8ca-4b2a-a504-e9cd3bf97485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:40.830426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0a8cd-f8ca-4b2a-a504-e9cd3bf97485 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:40.840570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 850/1706] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:40.841756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6089f27-5656-4863-9952-06ac765cb277 service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:40.844127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c6089f27-5656-4863-9952-06ac765cb277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:40.851592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 857/1707] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:40.851592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0a8cd-f8ca-4b2a-a504-e9cd3bf97485 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:40.851592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-37f0a8cd-f8ca-4b2a-a504-e9cd3bf97485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:40.868038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6089f27-5656-4863-9952-06ac765cb277 service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:40.878455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0a8cd-f8ca-4b2a-a504-e9cd3bf97485 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:40.879084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19784a2e-f870-4289-baaf-ec1a4790a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:40.880304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19784a2e-f870-4289-baaf-ec1a4790a488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.880933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19784a2e-f870-4289-baaf-ec1a4790a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.881402 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19784a2e-f870-4289-baaf-ec1a4790a488 admin admin] PATH_INFO: `/v3/projects/07cdce4b5ca14a03b8e2d298bad0516e/users/baffffd65a7c4f479a0fe218be4aa3b4/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.887848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:40.888931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:40.889219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:40.889514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] PATH_INFO: `/v3/projects/d293b21ca05e48ffa00b2ae4ba64d2c0` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:40.891246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d293b21ca05e48ffa00b2ae4ba64d2c0)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:40.893679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:40.928504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19784a2e-f870-4289-baaf-ec1a4790a488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07cdce4b5ca14a03b8e2d298bad0516e, user_id=baffffd65a7c4f479a0fe218be4aa3b4, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:40.931437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19784a2e-f870-4289-baaf-ec1a4790a488 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:41.082470 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 851/1708] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:40 2022] PUT /identity/v3/projects/07cdce4b5ca14a03b8e2d298bad0516e/users/baffffd65a7c4f479a0fe218be4aa3b4/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:41.086159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e379d63-ad41-4e3c-b7c8-c930e68058cc None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:41.086648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e379d63-ad41-4e3c-b7c8-c930e68058cc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:41.087982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e379d63-ad41-4e3c-b7c8-c930e68058cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:41.111195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd293b21ca05e48ffa00b2ae4ba64d2c0', 'request_id': 'req-f9e2a654-4a3a-4914-8504-f255ad1bef83'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:41.119114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd293b21ca05e48ffa00b2ae4ba64d2c0', 'request_id': 'req-f9e2a654-4a3a-4914-8504-f255ad1bef83'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:41.126701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1e379d63-ad41-4e3c-b7c8-c930e68058cc None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:41.128947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1e379d63-ad41-4e3c-b7c8-c930e68058cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:41.136748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd293b21ca05e48ffa00b2ae4ba64d2c0', 'request_id': 'req-f9e2a654-4a3a-4914-8504-f255ad1bef83'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:41.223412 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 852/1709] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:41.225492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be7ec2-ddee-4507-bf39-2397d6869fb2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:41.226045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be7ec2-ddee-4507-bf39-2397d6869fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:41.227273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be7ec2-ddee-4507-bf39-2397d6869fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:41.256378 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] The token cache is being invalidate because project d293b21ca05e48ffa00b2ae4ba64d2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:41.259451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:41.260250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-53be7ec2-ddee-4507-bf39-2397d6869fb2 None None] MFA Rules not processed for user `233ccfdda18d43f7b1fd585ca74037f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:41.261742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:41.265096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-53be7ec2-ddee-4507-bf39-2397d6869fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:41.268325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 858/1710] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:40 2022] DELETE /identity/v3/projects/d293b21ca05e48ffa00b2ae4ba64d2c0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:41.275587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:41.279146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:41.311769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a654-4a3a-4914-8504-f255ad1bef83 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:41.333750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b203b6-2755-4050-97d0-4d7b02aa0f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:41.334485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b203b6-2755-4050-97d0-4d7b02aa0f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:41.334896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b203b6-2755-4050-97d0-4d7b02aa0f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:41.335267 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b203b6-2755-4050-97d0-4d7b02aa0f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:41.336029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b203b6-2755-4050-97d0-4d7b02aa0f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:41.338052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b203b6-2755-4050-97d0-4d7b02aa0f45 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:41.342688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:41.372342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 853/1711] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:41.385347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be7ec2-ddee-4507-bf39-2397d6869fb2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:41.397444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-53be7ec2-ddee-4507-bf39-2397d6869fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:41.428083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be7ec2-ddee-4507-bf39-2397d6869fb2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:41.434173 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c319a72-5660-45b6-8254-393a365e0d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:41.435071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c319a72-5660-45b6-8254-393a365e0d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:41.435298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c319a72-5660-45b6-8254-393a365e0d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:41.435710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c319a72-5660-45b6-8254-393a365e0d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:41.436517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c319a72-5660-45b6-8254-393a365e0d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:41.441444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c319a72-5660-45b6-8254-393a365e0d5c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:41.453617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 859/1712] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:41 2022] POST /identity/v3/projects => generated 357 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:41.455331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131da2-7f6a-4f37-b815-962710a2b7b9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:41.455694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131da2-7f6a-4f37-b815-962710a2b7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:41.456058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131da2-7f6a-4f37-b815-962710a2b7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:41.502154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ec131da2-7f6a-4f37-b815-962710a2b7b9 None None] MFA Rules not processed for user `baffffd65a7c4f479a0fe218be4aa3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:41.503827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ec131da2-7f6a-4f37-b815-962710a2b7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:41.575579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:41.581772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 854/1713] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:41 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:41.584557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0a79b-2012-4f76-8bbb-e6e11dbac2fa None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:41.585078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0a79b-2012-4f76-8bbb-e6e11dbac2fa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:41.585646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0a79b-2012-4f76-8bbb-e6e11dbac2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:41.599350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 860/1714] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:41.601069 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd42f-59f3-4f5a-a38d-5885bb336825 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:41.601982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd42f-59f3-4f5a-a38d-5885bb336825 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:41.601982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd42f-59f3-4f5a-a38d-5885bb336825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:41.627063 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7e4fd42f-59f3-4f5a-a38d-5885bb336825 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:41.628654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7e4fd42f-59f3-4f5a-a38d-5885bb336825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:41.658939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e1a0a79b-2012-4f76-8bbb-e6e11dbac2fa None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:41.661373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e1a0a79b-2012-4f76-8bbb-e6e11dbac2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:41.764057 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 861/1715] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:41.765052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fd42f-59f3-4f5a-a38d-5885bb336825 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:41.766789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7e4fd42f-59f3-4f5a-a38d-5885bb336825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:41.797100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 855/1716] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:41.798688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249b5f-22b1-4508-b2dd-ee9b581a3995 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:41.799319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249b5f-22b1-4508-b2dd-ee9b581a3995 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:41.799730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249b5f-22b1-4508-b2dd-ee9b581a3995 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:41.801784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 856/1717] 10.222.0.55 () {54 vars in 912 bytes} [Fri Sep 2 09:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:31:41.802664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16249b5f-22b1-4508-b2dd-ee9b581a3995 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:41.831094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16249b5f-22b1-4508-b2dd-ee9b581a3995 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:41.844855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c684b3-eb43-4b24-956b-696a36307f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:41.845557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c684b3-eb43-4b24-956b-696a36307f21 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:41.845927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c684b3-eb43-4b24-956b-696a36307f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:41.846268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c684b3-eb43-4b24-956b-696a36307f21 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:41.847015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c684b3-eb43-4b24-956b-696a36307f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:41.849942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c684b3-eb43-4b24-956b-696a36307f21 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:41.886426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fd42f-59f3-4f5a-a38d-5885bb336825 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:41.892934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542693c-8917-43ac-b91d-4336fc0bc4f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:41.893657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542693c-8917-43ac-b91d-4336fc0bc4f7 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:41.894015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542693c-8917-43ac-b91d-4336fc0bc4f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:41.894354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542693c-8917-43ac-b91d-4336fc0bc4f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:41.896351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3542693c-8917-43ac-b91d-4336fc0bc4f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:41.966371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 857/1718] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:41 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:41.967389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c684b3-eb43-4b24-956b-696a36307f21 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:41.977334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542693c-8917-43ac-b91d-4336fc0bc4f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:41.980178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542693c-8917-43ac-b91d-4336fc0bc4f7 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:41.988760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c684b3-eb43-4b24-956b-696a36307f21 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.001060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acce30-2c8b-40e9-a800-fecdb1b5146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.001936 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acce30-2c8b-40e9-a800-fecdb1b5146e admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.002860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acce30-2c8b-40e9-a800-fecdb1b5146e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.003350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acce30-2c8b-40e9-a800-fecdb1b5146e admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.004268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 862/1719] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:42.004441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acce30-2c8b-40e9-a800-fecdb1b5146e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.005706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542693c-8917-43ac-b91d-4336fc0bc4f7 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:42.006797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acce30-2c8b-40e9-a800-fecdb1b5146e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:42.008182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3542693c-8917-43ac-b91d-4336fc0bc4f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:42.027055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542693c-8917-43ac-b91d-4336fc0bc4f7 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.032132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208734b9-9091-4ae3-b6d9-66028c9a8411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.032745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208734b9-9091-4ae3-b6d9-66028c9a8411 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.033419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208734b9-9091-4ae3-b6d9-66028c9a8411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.033707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208734b9-9091-4ae3-b6d9-66028c9a8411 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.034619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208734b9-9091-4ae3-b6d9-66028c9a8411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.036938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208734b9-9091-4ae3-b6d9-66028c9a8411 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:42.094101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 858/1720] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:41 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:42.099406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae15b-278c-4a55-bd43-15e0109094d8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.099783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae15b-278c-4a55-bd43-15e0109094d8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.100157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae15b-278c-4a55-bd43-15e0109094d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.134606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-26dae15b-278c-4a55-bd43-15e0109094d8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:42.136877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-26dae15b-278c-4a55-bd43-15e0109094d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:42.148330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 859/1721] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:42.149710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dae15b-278c-4a55-bd43-15e0109094d8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:42.162266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dae15b-278c-4a55-bd43-15e0109094d8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.175270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 863/1722] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:42 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:42.180079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a8b9-12d4-438d-a054-7d5c961c874c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.181092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a8b9-12d4-438d-a054-7d5c961c874c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.181384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a8b9-12d4-438d-a054-7d5c961c874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.187549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a373c4-af34-49a9-a83c-a2a05b596cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.188837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a373c4-af34-49a9-a83c-a2a05b596cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.189369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a373c4-af34-49a9-a83c-a2a05b596cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.190353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a373c4-af34-49a9-a83c-a2a05b596cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.192065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a373c4-af34-49a9-a83c-a2a05b596cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:42.192361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a373c4-af34-49a9-a83c-a2a05b596cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.207554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a373c4-af34-49a9-a83c-a2a05b596cd6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:42.251540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 860/1723] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:42.253795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a373c4-af34-49a9-a83c-a2a05b596cd6 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:42.282490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a373c4-af34-49a9-a83c-a2a05b596cd6 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.287696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6b71a8b9-12d4-438d-a054-7d5c961c874c None None] MFA Rules not processed for user `81bb83de9f794ac9b02e5dca2df3e4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:42.291403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6b71a8b9-12d4-438d-a054-7d5c961c874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:42.408641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 864/1724] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:31:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:42.409612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a8b9-12d4-438d-a054-7d5c961c874c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:42.434471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f616c4-335b-4d4e-ac3f-e25d236abb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.435086 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f616c4-335b-4d4e-ac3f-e25d236abb46 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.435342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f616c4-335b-4d4e-ac3f-e25d236abb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.435617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f616c4-335b-4d4e-ac3f-e25d236abb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.436298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f616c4-335b-4d4e-ac3f-e25d236abb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.437933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f616c4-335b-4d4e-ac3f-e25d236abb46 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:42.465231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 861/1725] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:42.472360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f616c4-335b-4d4e-ac3f-e25d236abb46 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:42.486059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f616c4-335b-4d4e-ac3f-e25d236abb46 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.497823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0f498-bff0-4763-88d6-c8ac6e2ca5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.499108 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0f498-bff0-4763-88d6-c8ac6e2ca5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.499386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0f498-bff0-4763-88d6-c8ac6e2ca5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.499662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0f498-bff0-4763-88d6-c8ac6e2ca5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.500333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0f498-bff0-4763-88d6-c8ac6e2ca5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:42.500634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0f498-bff0-4763-88d6-c8ac6e2ca5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.502250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0f498-bff0-4763-88d6-c8ac6e2ca5aa admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:42.530988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 862/1726] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:42.536474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0f498-bff0-4763-88d6-c8ac6e2ca5aa admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:42.538025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a8b9-12d4-438d-a054-7d5c961c874c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.549742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dffc55-25ac-4c92-9e3f-791f59f0dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.551219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dffc55-25ac-4c92-9e3f-791f59f0dd38 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.551219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dffc55-25ac-4c92-9e3f-791f59f0dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.551219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dffc55-25ac-4c92-9e3f-791f59f0dd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.551452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dffc55-25ac-4c92-9e3f-791f59f0dd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.553070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dffc55-25ac-4c92-9e3f-791f59f0dd38 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:42.557213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0f498-bff0-4763-88d6-c8ac6e2ca5aa admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.574577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156dccf-3ed2-4523-b058-757cdc91b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.575203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156dccf-3ed2-4523-b058-757cdc91b9bf admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.575492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156dccf-3ed2-4523-b058-757cdc91b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.575768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156dccf-3ed2-4523-b058-757cdc91b9bf admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.576437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156dccf-3ed2-4523-b058-757cdc91b9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.578395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156dccf-3ed2-4523-b058-757cdc91b9bf admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:42.581096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 865/1727] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:42.582590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dffc55-25ac-4c92-9e3f-791f59f0dd38 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:42.598592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dffc55-25ac-4c92-9e3f-791f59f0dd38 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.603680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a606af-9e32-4bae-b36b-e225c84c953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.604345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a606af-9e32-4bae-b36b-e225c84c953e admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.604626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a606af-9e32-4bae-b36b-e225c84c953e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.605311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a606af-9e32-4bae-b36b-e225c84c953e admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.605564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a606af-9e32-4bae-b36b-e225c84c953e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.607467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a606af-9e32-4bae-b36b-e225c84c953e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:42.720095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 866/1728] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:42 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:42.724284 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 863/1729] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:42 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:42.725330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52930b45-0ac1-44c7-afcd-805a2922a957 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.725473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156dccf-3ed2-4523-b058-757cdc91b9bf admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:42.725829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52930b45-0ac1-44c7-afcd-805a2922a957 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.727610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6156dccf-3ed2-4523-b058-757cdc91b9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:42.728118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52930b45-0ac1-44c7-afcd-805a2922a957 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.731210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 867/1730] 10.222.0.55 () {54 vars in 912 bytes} [Fri Sep 2 09:31:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:31:42.732153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52930b45-0ac1-44c7-afcd-805a2922a957 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:42.763077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156dccf-3ed2-4523-b058-757cdc91b9bf admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.896428 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926105-9ecb-418a-8afc-d3b6ae81f17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.896609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926105-9ecb-418a-8afc-d3b6ae81f17c service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.896772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926105-9ecb-418a-8afc-d3b6ae81f17c service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.897044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926105-9ecb-418a-8afc-d3b6ae81f17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.904613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52930b45-0ac1-44c7-afcd-805a2922a957 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.913770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926105-9ecb-418a-8afc-d3b6ae81f17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.913955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42d958-bb37-43e7-b10c-0d65bc1158b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.914662 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42d958-bb37-43e7-b10c-0d65bc1158b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.917683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42d958-bb37-43e7-b10c-0d65bc1158b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.917777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926105-9ecb-418a-8afc-d3b6ae81f17c service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:42.917857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42d958-bb37-43e7-b10c-0d65bc1158b6 admin admin] PATH_INFO: `/v3/projects/f8f906e41dc04ddc9210f96e355795d5/users/f86c177602d44a6cacdb6f558d72ad97/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.924711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 864/1731] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:42.925192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926105-9ecb-418a-8afc-d3b6ae81f17c service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:42.934776 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42d958-bb37-43e7-b10c-0d65bc1158b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f906e41dc04ddc9210f96e355795d5, user_id=f86c177602d44a6cacdb6f558d72ad97, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.937987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42d958-bb37-43e7-b10c-0d65bc1158b6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:42.957339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926105-9ecb-418a-8afc-d3b6ae81f17c service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:42.969399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e68c47-453d-4eea-9a4b-15fcdf36a75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:42.970407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e68c47-453d-4eea-9a4b-15fcdf36a75f admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:42.970792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e68c47-453d-4eea-9a4b-15fcdf36a75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:42.978865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e68c47-453d-4eea-9a4b-15fcdf36a75f admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:42.978865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e68c47-453d-4eea-9a4b-15fcdf36a75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:42.978865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e68c47-453d-4eea-9a4b-15fcdf36a75f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:43.040803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 868/1732] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:42 2022] PUT /identity/v3/projects/f8f906e41dc04ddc9210f96e355795d5/users/f86c177602d44a6cacdb6f558d72ad97/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:43.047699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42d958-bb37-43e7-b10c-0d65bc1158b6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:43.121910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:43.130217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 865/1733] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:42 2022] POST /identity/v3/projects => generated 369 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:43.130217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e68c47-453d-4eea-9a4b-15fcdf36a75f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:43.180474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42d958-bb37-43e7-b10c-0d65bc1158b6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:43.280669 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e68c47-453d-4eea-9a4b-15fcdf36a75f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:43.304934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b22399-684f-4552-8b04-82354c0e8af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:43.304934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22399-684f-4552-8b04-82354c0e8af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:43.304934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22399-684f-4552-8b04-82354c0e8af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:43.304934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22399-684f-4552-8b04-82354c0e8af6 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:43.305226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b22399-684f-4552-8b04-82354c0e8af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:43.305226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b22399-684f-4552-8b04-82354c0e8af6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:43.309398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b223-8e0d-40ab-b58f-8dee92436886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:43.310031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b223-8e0d-40ab-b58f-8dee92436886 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:43.310312 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b223-8e0d-40ab-b58f-8dee92436886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:43.310588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b223-8e0d-40ab-b58f-8dee92436886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:43.312181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48b223-8e0d-40ab-b58f-8dee92436886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:43.313871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48b223-8e0d-40ab-b58f-8dee92436886 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:43.326999 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:43.328805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 869/1734] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:43.329714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b223-8e0d-40ab-b58f-8dee92436886 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:43.348006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b223-8e0d-40ab-b58f-8dee92436886 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:43.377161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc3b38-1387-4996-abfe-b1b708349528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:43.377537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc3b38-1387-4996-abfe-b1b708349528 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:43.377817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc3b38-1387-4996-abfe-b1b708349528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:43.378088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc3b38-1387-4996-abfe-b1b708349528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:43.378876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc3b38-1387-4996-abfe-b1b708349528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:43.380387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc3b38-1387-4996-abfe-b1b708349528 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:43.394734 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 870/1735] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:43.396243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e77e-3449-48ab-b7bf-1b01e2837e45 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:43.396537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e77e-3449-48ab-b7bf-1b01e2837e45 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:43.396817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e77e-3449-48ab-b7bf-1b01e2837e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:43.424051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8e65e77e-3449-48ab-b7bf-1b01e2837e45 None None] MFA Rules not processed for user `81bb83de9f794ac9b02e5dca2df3e4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:43.425884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8e65e77e-3449-48ab-b7bf-1b01e2837e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:43.457627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 866/1736] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:43 2022] POST /identity/v3/users => generated 303 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:43.457627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b22399-684f-4552-8b04-82354c0e8af6 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:43.478833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b22399-684f-4552-8b04-82354c0e8af6 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:43.498299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc0d86-1096-4920-a070-209cca51b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:43.498943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc0d86-1096-4920-a070-209cca51b5fd admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:43.499330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc0d86-1096-4920-a070-209cca51b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:43.499478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc0d86-1096-4920-a070-209cca51b5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:43.502448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc0d86-1096-4920-a070-209cca51b5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:43.507128 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc0d86-1096-4920-a070-209cca51b5fd admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:43.554123 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 867/1737] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:43.555064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc0d86-1096-4920-a070-209cca51b5fd admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:43.563247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 871/1738] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:31:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:43.564987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e77e-3449-48ab-b7bf-1b01e2837e45 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:43.597645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e77e-3449-48ab-b7bf-1b01e2837e45 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:43.609679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc0d86-1096-4920-a070-209cca51b5fd admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:43.617152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a365-1bfe-4aaa-8b78-14ee4e2315f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:43.617152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a365-1bfe-4aaa-8b78-14ee4e2315f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:43.619068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a365-1bfe-4aaa-8b78-14ee4e2315f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:43.619798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a365-1bfe-4aaa-8b78-14ee4e2315f6 admin admin] PATH_INFO: `/v3/projects/625eed16498046e5af22b590597c54e0/users/d9df118bb170477aa2ca2811a13efa8e/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:43.626347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb62799-08f8-4619-b75d-aceded51f602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:43.630168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb62799-08f8-4619-b75d-aceded51f602 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:43.630430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb62799-08f8-4619-b75d-aceded51f602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:43.630698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb62799-08f8-4619-b75d-aceded51f602 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:43.631342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb62799-08f8-4619-b75d-aceded51f602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:43.636054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb62799-08f8-4619-b75d-aceded51f602 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:43.682027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6a365-1bfe-4aaa-8b78-14ee4e2315f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625eed16498046e5af22b590597c54e0, user_id=d9df118bb170477aa2ca2811a13efa8e, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:43.688798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6a365-1bfe-4aaa-8b78-14ee4e2315f6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:43.727958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:43.804460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 868/1739] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:43 2022] POST /identity/v3/users => generated 285 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:43.806026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb62799-08f8-4619-b75d-aceded51f602 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:43.836684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 872/1740] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:43 2022] PUT /identity/v3/projects/625eed16498046e5af22b590597c54e0/users/d9df118bb170477aa2ca2811a13efa8e/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:43.836684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a365-1bfe-4aaa-8b78-14ee4e2315f6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:43.842257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb62799-08f8-4619-b75d-aceded51f602 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:43.977764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3ec64-3ebc-4862-a16d-9f694603ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:43.978603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3ec64-3ebc-4862-a16d-9f694603ce22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:43.978975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3ec64-3ebc-4862-a16d-9f694603ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:43.979344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3ec64-3ebc-4862-a16d-9f694603ce22 admin admin] PATH_INFO: `/v3/projects/1225ab88936e4b698cb9df29d39755d4/users/fb773d093c994fb6acc6e2ccd44e2028/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.007661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a365-1bfe-4aaa-8b78-14ee4e2315f6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:44.015221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25488c21-cd5a-4718-8c69-9a2b730c7ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:44.016029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25488c21-cd5a-4718-8c69-9a2b730c7ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.016474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25488c21-cd5a-4718-8c69-9a2b730c7ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.016757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25488c21-cd5a-4718-8c69-9a2b730c7ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.017744 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25488c21-cd5a-4718-8c69-9a2b730c7ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.019493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25488c21-cd5a-4718-8c69-9a2b730c7ff5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.030826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3ec64-3ebc-4862-a16d-9f694603ce22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1225ab88936e4b698cb9df29d39755d4, user_id=fb773d093c994fb6acc6e2ccd44e2028, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.037134 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3ec64-3ebc-4862-a16d-9f694603ce22 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.039081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 873/1741] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:44.040180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25488c21-cd5a-4718-8c69-9a2b730c7ff5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:44.055151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25488c21-cd5a-4718-8c69-9a2b730c7ff5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:44.061254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a79b4b-c306-4f00-b96c-0b888d12be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:44.062084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79b4b-c306-4f00-b96c-0b888d12be43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.062376 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79b4b-c306-4f00-b96c-0b888d12be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.062718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79b4b-c306-4f00-b96c-0b888d12be43 admin admin] PATH_INFO: `/v3/projects/f8f906e41dc04ddc9210f96e355795d5/users/f86c177602d44a6cacdb6f558d72ad97/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.065538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a79b4b-c306-4f00-b96c-0b888d12be43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f906e41dc04ddc9210f96e355795d5, user_id=f86c177602d44a6cacdb6f558d72ad97, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.070006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a79b4b-c306-4f00-b96c-0b888d12be43 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.082511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 874/1742] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:44 2022] PUT /identity/v3/projects/f8f906e41dc04ddc9210f96e355795d5/users/f86c177602d44a6cacdb6f558d72ad97/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:44.083556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a79b4b-c306-4f00-b96c-0b888d12be43 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:44.147334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 869/1743] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:43 2022] PUT /identity/v3/projects/1225ab88936e4b698cb9df29d39755d4/users/fb773d093c994fb6acc6e2ccd44e2028/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:44.147334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3ec64-3ebc-4862-a16d-9f694603ce22 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:44.169864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a79b4b-c306-4f00-b96c-0b888d12be43 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:44.226695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093a322-425a-468f-8473-aea4b6ef0568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:44.227479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093a322-425a-468f-8473-aea4b6ef0568 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.227758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093a322-425a-468f-8473-aea4b6ef0568 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.228251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093a322-425a-468f-8473-aea4b6ef0568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.236951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:44.237282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093a322-425a-468f-8473-aea4b6ef0568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.240138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093a322-425a-468f-8473-aea4b6ef0568 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.240790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3ec64-3ebc-4862-a16d-9f694603ce22 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:44.248887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438346d3-c2cf-4538-9e93-a3b68c39d82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:44.249710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438346d3-c2cf-4538-9e93-a3b68c39d82b admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.249991 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438346d3-c2cf-4538-9e93-a3b68c39d82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.250262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438346d3-c2cf-4538-9e93-a3b68c39d82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.250913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438346d3-c2cf-4538-9e93-a3b68c39d82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.253370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438346d3-c2cf-4538-9e93-a3b68c39d82b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.259785 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 875/1744] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:44.260646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093a322-425a-468f-8473-aea4b6ef0568 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:44.262275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5093a322-425a-468f-8473-aea4b6ef0568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:44.284955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 870/1745] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:44.287158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1b35c-1ef0-4037-a222-701ded585cfe None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.287577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1b35c-1ef0-4037-a222-701ded585cfe None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.288085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1b35c-1ef0-4037-a222-701ded585cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.340721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-90a1b35c-1ef0-4037-a222-701ded585cfe None None] MFA Rules not processed for user `d9df118bb170477aa2ca2811a13efa8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:44.342221 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-90a1b35c-1ef0-4037-a222-701ded585cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:44.398599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093a322-425a-468f-8473-aea4b6ef0568 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:44.404779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fdb04-6a7b-4a0c-84f5-2b5fd559de96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:44.405411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fdb04-6a7b-4a0c-84f5-2b5fd559de96 service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.405693 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fdb04-6a7b-4a0c-84f5-2b5fd559de96 service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.406144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fdb04-6a7b-4a0c-84f5-2b5fd559de96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.408442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e28fdb04-6a7b-4a0c-84f5-2b5fd559de96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:44.435770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fdb04-6a7b-4a0c-84f5-2b5fd559de96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.440798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fdb04-6a7b-4a0c-84f5-2b5fd559de96 service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.453443 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 871/1746] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:44.459496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2103e-8224-4183-91da-0e095cc03b9c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.460618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2103e-8224-4183-91da-0e095cc03b9c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.461459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2103e-8224-4183-91da-0e095cc03b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.471389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 876/1747] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:44.481783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fdb04-6a7b-4a0c-84f5-2b5fd559de96 service placement] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:44.484922 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-73c2103e-8224-4183-91da-0e095cc03b9c None None] MFA Rules not processed for user `8bd18df842724159869f630f96229758`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:44.486348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-73c2103e-8224-4183-91da-0e095cc03b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:44.513831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fdb04-6a7b-4a0c-84f5-2b5fd559de96 service placement] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:44.528256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22526a-25b8-45d2-95f3-cf4cbaf94e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:44.528882 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22526a-25b8-45d2-95f3-cf4cbaf94e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.529161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22526a-25b8-45d2-95f3-cf4cbaf94e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.529432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22526a-25b8-45d2-95f3-cf4cbaf94e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.530167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22526a-25b8-45d2-95f3-cf4cbaf94e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.531792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22526a-25b8-45d2-95f3-cf4cbaf94e7c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.553748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 877/1748] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:44.555174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459260-6fe7-4b06-b75d-6b222d6738e8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.555471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459260-6fe7-4b06-b75d-6b222d6738e8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.555732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459260-6fe7-4b06-b75d-6b222d6738e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.570488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 872/1749] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:44.572130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2103e-8224-4183-91da-0e095cc03b9c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:44.588689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2103e-8224-4183-91da-0e095cc03b9c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:44.596638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598611f-05aa-41ec-9f7b-35bdbd74f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:44.597618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598611f-05aa-41ec-9f7b-35bdbd74f401 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.598304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598611f-05aa-41ec-9f7b-35bdbd74f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.598774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598611f-05aa-41ec-9f7b-35bdbd74f401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.599721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598611f-05aa-41ec-9f7b-35bdbd74f401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.604136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598611f-05aa-41ec-9f7b-35bdbd74f401 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.618202 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-94459260-6fe7-4b06-b75d-6b222d6738e8 None None] MFA Rules not processed for user `f86c177602d44a6cacdb6f558d72ad97`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:44.622821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 873/1750] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:44.624089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-94459260-6fe7-4b06-b75d-6b222d6738e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:44.624753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838992c-5f07-4f31-a37f-d3f5ef2a0347 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.625546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838992c-5f07-4f31-a37f-d3f5ef2a0347 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.625925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838992c-5f07-4f31-a37f-d3f5ef2a0347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.652868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:44.661214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b838992c-5f07-4f31-a37f-d3f5ef2a0347 None None] MFA Rules not processed for user `702b8f59f5d348acb1263f058aed84a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:44.662523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b838992c-5f07-4f31-a37f-d3f5ef2a0347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:44.776730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 874/1751] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:44.776730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838992c-5f07-4f31-a37f-d3f5ef2a0347 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:44.778155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:44.782321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 878/1752] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:44.782321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459260-6fe7-4b06-b75d-6b222d6738e8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:44.796300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459260-6fe7-4b06-b75d-6b222d6738e8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:44.799945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838992c-5f07-4f31-a37f-d3f5ef2a0347 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:44.817740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb6589-4c90-407a-b151-e793e5fa5a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:44.818646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb6589-4c90-407a-b151-e793e5fa5a3d admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.819622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb6589-4c90-407a-b151-e793e5fa5a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.820382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb6589-4c90-407a-b151-e793e5fa5a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.822683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb6589-4c90-407a-b151-e793e5fa5a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.824996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb6589-4c90-407a-b151-e793e5fa5a3d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.839819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 875/1753] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:44.840920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb6589-4c90-407a-b151-e793e5fa5a3d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:44.851933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b398a9-1265-4508-ac4e-e2dd4fa862e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:44.852600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b398a9-1265-4508-ac4e-e2dd4fa862e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.852887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b398a9-1265-4508-ac4e-e2dd4fa862e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.853163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b398a9-1265-4508-ac4e-e2dd4fa862e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.853811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b398a9-1265-4508-ac4e-e2dd4fa862e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.859021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b398a9-1265-4508-ac4e-e2dd4fa862e9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.860680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb6589-4c90-407a-b151-e793e5fa5a3d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:44.874649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a68d0-b68a-40f5-940a-973799a8f636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:44.875487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a68d0-b68a-40f5-940a-973799a8f636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:44.875622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a68d0-b68a-40f5-940a-973799a8f636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:44.875860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a68d0-b68a-40f5-940a-973799a8f636 admin admin] PATH_INFO: `/v3/projects/62951b6cd2004e309e1d622adbff9bea/users/5ef2d85fad94416e9e84d6aad07ddf72/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:44.917308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a68d0-b68a-40f5-940a-973799a8f636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62951b6cd2004e309e1d622adbff9bea, user_id=5ef2d85fad94416e9e84d6aad07ddf72, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:44.920957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a68d0-b68a-40f5-940a-973799a8f636 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:44.977102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 879/1754] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:44 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:44.977102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b398a9-1265-4508-ac4e-e2dd4fa862e9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:45.001127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 876/1755] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:44 2022] PUT /identity/v3/projects/62951b6cd2004e309e1d622adbff9bea/users/5ef2d85fad94416e9e84d6aad07ddf72/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:45.002118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a68d0-b68a-40f5-940a-973799a8f636 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:45.005254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5b6a68d0-b68a-40f5-940a-973799a8f636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:45.074043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b398a9-1265-4508-ac4e-e2dd4fa862e9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:45.100983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a68d0-b68a-40f5-940a-973799a8f636 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:45.105748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88534681-8077-4ab9-bb75-803acd72f156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:45.108382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88534681-8077-4ab9-bb75-803acd72f156 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:45.108382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88534681-8077-4ab9-bb75-803acd72f156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:45.108382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88534681-8077-4ab9-bb75-803acd72f156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:45.154398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0491786-01e2-444a-900d-a3dc248fb73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:45.155547 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0491786-01e2-444a-900d-a3dc248fb73c admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:45.155972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0491786-01e2-444a-900d-a3dc248fb73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:45.156392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0491786-01e2-444a-900d-a3dc248fb73c admin admin] PATH_INFO: `/v3/projects/1225ab88936e4b698cb9df29d39755d4/users/fb773d093c994fb6acc6e2ccd44e2028/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:45.159268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0491786-01e2-444a-900d-a3dc248fb73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1225ab88936e4b698cb9df29d39755d4, user_id=fb773d093c994fb6acc6e2ccd44e2028, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:45.164220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0491786-01e2-444a-900d-a3dc248fb73c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:45.185350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 880/1756] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:44 2022] PUT /identity/v3/projects/1225ab88936e4b698cb9df29d39755d4/users/fb773d093c994fb6acc6e2ccd44e2028/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:45.186844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0491786-01e2-444a-900d-a3dc248fb73c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:45.207412 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88534681-8077-4ab9-bb75-803acd72f156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:45.209063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88534681-8077-4ab9-bb75-803acd72f156 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:45.229015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 877/1757] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:45.232247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88534681-8077-4ab9-bb75-803acd72f156 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:45.259414 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88534681-8077-4ab9-bb75-803acd72f156 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:45.278586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0491786-01e2-444a-900d-a3dc248fb73c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:45.293238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a1a34-0267-45c5-88e9-2107bd2ae971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:45.293952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a1a34-0267-45c5-88e9-2107bd2ae971 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:45.294237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a1a34-0267-45c5-88e9-2107bd2ae971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:45.294519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a1a34-0267-45c5-88e9-2107bd2ae971 admin admin] PATH_INFO: `/v3/projects/7ba5fc7c78f7431b9d7aa96de70ee97e/users/a7931115c769434586d62900065afe93/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:45.348318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a1a34-0267-45c5-88e9-2107bd2ae971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba5fc7c78f7431b9d7aa96de70ee97e, user_id=a7931115c769434586d62900065afe93, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:45.353704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a1a34-0267-45c5-88e9-2107bd2ae971 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:45.392403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220a673-46fc-40ac-a840-cb0097b7b517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:45.402615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a673-46fc-40ac-a840-cb0097b7b517 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:45.402615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a673-46fc-40ac-a840-cb0097b7b517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:45.402615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a673-46fc-40ac-a840-cb0097b7b517 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:45.402615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220a673-46fc-40ac-a840-cb0097b7b517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:45.402615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220a673-46fc-40ac-a840-cb0097b7b517 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:45.483199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 881/1758] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:45 2022] PUT /identity/v3/projects/7ba5fc7c78f7431b9d7aa96de70ee97e/users/a7931115c769434586d62900065afe93/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:45.493905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e20db0-804f-4c7c-a0a7-efaa5c10e62d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:45.493905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e20db0-804f-4c7c-a0a7-efaa5c10e62d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:45.493905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e20db0-804f-4c7c-a0a7-efaa5c10e62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:45.516325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 878/1759] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:45 2022] POST /identity/v3/users => generated 295 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:45.519583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79dc19-3b87-44ec-8765-6b2821f9cc20 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:45.519583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79dc19-3b87-44ec-8765-6b2821f9cc20 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:45.519583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79dc19-3b87-44ec-8765-6b2821f9cc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:45.536368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-51e20db0-804f-4c7c-a0a7-efaa5c10e62d None None] MFA Rules not processed for user `5ef2d85fad94416e9e84d6aad07ddf72`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:45.537809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-51e20db0-804f-4c7c-a0a7-efaa5c10e62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:45.566866 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2b79dc19-3b87-44ec-8765-6b2821f9cc20 None None] MFA Rules not processed for user `fb773d093c994fb6acc6e2ccd44e2028`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:45.568114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2b79dc19-3b87-44ec-8765-6b2821f9cc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:45.634589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 882/1760] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:45 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:45.636221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422160d-4ab2-4fc2-b508-b4c7e336e709 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:45.636511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422160d-4ab2-4fc2-b508-b4c7e336e709 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:45.636788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422160d-4ab2-4fc2-b508-b4c7e336e709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:45.670711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0422160d-4ab2-4fc2-b508-b4c7e336e709 None None] MFA Rules not processed for user `a7931115c769434586d62900065afe93`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:45.672071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0422160d-4ab2-4fc2-b508-b4c7e336e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:45.768275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 879/1761] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:45.769569 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79dc19-3b87-44ec-8765-6b2821f9cc20 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:45.788905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 883/1762] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:45.798003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422160d-4ab2-4fc2-b508-b4c7e336e709 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:45.855469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:45.886645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422160d-4ab2-4fc2-b508-b4c7e336e709 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:45.908302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cf851-5ca7-4d7b-8a4f-af4ded3cc55d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:45.908942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cf851-5ca7-4d7b-8a4f-af4ded3cc55d service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:45.911650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cf851-5ca7-4d7b-8a4f-af4ded3cc55d service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:45.914855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cf851-5ca7-4d7b-8a4f-af4ded3cc55d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:45.920256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a14cf851-5ca7-4d7b-8a4f-af4ded3cc55d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:45.932442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79dc19-3b87-44ec-8765-6b2821f9cc20 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:45.938336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdd7dd-67e9-42d9-b592-0517b77a4559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:45.939045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdd7dd-67e9-42d9-b592-0517b77a4559 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:45.940490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdd7dd-67e9-42d9-b592-0517b77a4559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:45.940490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdd7dd-67e9-42d9-b592-0517b77a4559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:45.940490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdd7dd-67e9-42d9-b592-0517b77a4559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:45.942058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdd7dd-67e9-42d9-b592-0517b77a4559 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:45.954047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 880/1763] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:45.954881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdd7dd-67e9-42d9-b592-0517b77a4559 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:45.966790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdd7dd-67e9-42d9-b592-0517b77a4559 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:45.975418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cfa02-5561-450a-8dd3-fbc0936ff513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:45.984491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cfa02-5561-450a-8dd3-fbc0936ff513 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:45.984804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cfa02-5561-450a-8dd3-fbc0936ff513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:45.985536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cfa02-5561-450a-8dd3-fbc0936ff513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:45.986290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cfa02-5561-450a-8dd3-fbc0936ff513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:45.988645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cfa02-5561-450a-8dd3-fbc0936ff513 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:46.057258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cf851-5ca7-4d7b-8a4f-af4ded3cc55d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:46.064176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cf851-5ca7-4d7b-8a4f-af4ded3cc55d service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:46.074389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 884/1764] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:46.081693 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:46.096715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cf851-5ca7-4d7b-8a4f-af4ded3cc55d service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:46.098150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a14cf851-5ca7-4d7b-8a4f-af4ded3cc55d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:46.118768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 881/1765] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:45 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:46.118768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cfa02-5561-450a-8dd3-fbc0936ff513 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:46.125851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cf851-5ca7-4d7b-8a4f-af4ded3cc55d service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:46.273136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcae84-8c17-4d60-92ef-54db4e6c1a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:46.274044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcae84-8c17-4d60-92ef-54db4e6c1a80 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:46.274494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcae84-8c17-4d60-92ef-54db4e6c1a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:46.275775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcae84-8c17-4d60-92ef-54db4e6c1a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:46.363981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cfa02-5561-450a-8dd3-fbc0936ff513 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:46.368003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcae84-8c17-4d60-92ef-54db4e6c1a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:46.370944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcae84-8c17-4d60-92ef-54db4e6c1a80 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:46.385944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46a87-030d-40ad-8265-a42ece848f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:46.387369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46a87-030d-40ad-8265-a42ece848f36 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:46.387694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46a87-030d-40ad-8265-a42ece848f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:46.387959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46a87-030d-40ad-8265-a42ece848f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:46.388550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 885/1766] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:46.405639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcae84-8c17-4d60-92ef-54db4e6c1a80 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:46.405938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b46a87-030d-40ad-8265-a42ece848f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:46.409302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b46a87-030d-40ad-8265-a42ece848f36 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:46.422278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcae84-8c17-4d60-92ef-54db4e6c1a80 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:46.430105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235388c8-cdc1-4224-ab7b-b8b3b1f7c6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:46.431175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235388c8-cdc1-4224-ab7b-b8b3b1f7c6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:46.431457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235388c8-cdc1-4224-ab7b-b8b3b1f7c6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:46.431790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235388c8-cdc1-4224-ab7b-b8b3b1f7c6c4 admin admin] PATH_INFO: `/v3/projects/86346965d8964f999a71e5fbf527ca60/users/ba699ec9ad484db7bda04b6597c84822/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:46.456925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235388c8-cdc1-4224-ab7b-b8b3b1f7c6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86346965d8964f999a71e5fbf527ca60, user_id=ba699ec9ad484db7bda04b6597c84822, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:46.460359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235388c8-cdc1-4224-ab7b-b8b3b1f7c6c4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:46.612728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 886/1767] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:46 2022] PUT /identity/v3/projects/86346965d8964f999a71e5fbf527ca60/users/ba699ec9ad484db7bda04b6597c84822/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:46.613667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235388c8-cdc1-4224-ab7b-b8b3b1f7c6c4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:46.622209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 882/1768] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:46 2022] POST /identity/v3/projects => generated 369 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:46.622209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46a87-030d-40ad-8265-a42ece848f36 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:46.700336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235388c8-cdc1-4224-ab7b-b8b3b1f7c6c4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:46.714729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46a87-030d-40ad-8265-a42ece848f36 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:46.720425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3e6a1-dcd1-40e0-ab63-cc4263e52690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:46.725407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3e6a1-dcd1-40e0-ab63-cc4263e52690 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:46.725559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbea26-9c44-4f95-8548-0d0282a9f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:46.725656 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3e6a1-dcd1-40e0-ab63-cc4263e52690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:46.725656 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3e6a1-dcd1-40e0-ab63-cc4263e52690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:46.725818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbea26-9c44-4f95-8548-0d0282a9f0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:46.725905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3e6a1-dcd1-40e0-ab63-cc4263e52690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:46.725986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbea26-9c44-4f95-8548-0d0282a9f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:46.725986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbea26-9c44-4f95-8548-0d0282a9f0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:46.725986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbea26-9c44-4f95-8548-0d0282a9f0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:46.726192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3e6a1-dcd1-40e0-ab63-cc4263e52690 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:46.726721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbea26-9c44-4f95-8548-0d0282a9f0d6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:46.742280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 883/1769] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:46.743486 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3e6a1-dcd1-40e0-ab63-cc4263e52690 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:46.755941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3e6a1-dcd1-40e0-ab63-cc4263e52690 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:46.762501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbadf02-40a4-45e3-a088-8cc31109d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:46.763315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbadf02-40a4-45e3-a088-8cc31109d83c admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:46.763737 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbadf02-40a4-45e3-a088-8cc31109d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:46.764307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbadf02-40a4-45e3-a088-8cc31109d83c admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:46.765160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbadf02-40a4-45e3-a088-8cc31109d83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:46.767273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbadf02-40a4-45e3-a088-8cc31109d83c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:46.775058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:46.843178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 887/1770] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:46 2022] POST /identity/v3/users => generated 307 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:46.843178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbea26-9c44-4f95-8548-0d0282a9f0d6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:46.862988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 884/1771] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:46 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:46.864144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbadf02-40a4-45e3-a088-8cc31109d83c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:46.870245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbea26-9c44-4f95-8548-0d0282a9f0d6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:46.887874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbadf02-40a4-45e3-a088-8cc31109d83c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:46.889129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbbb97-3a87-4341-beee-f69633edd3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:46.890906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbbb97-3a87-4341-beee-f69633edd3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:46.892611 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbbb97-3a87-4341-beee-f69633edd3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:46.892998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbbb97-3a87-4341-beee-f69633edd3f8 admin admin] PATH_INFO: `/v3/projects/86346965d8964f999a71e5fbf527ca60/users/ba699ec9ad484db7bda04b6597c84822/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:46.898579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbbb97-3a87-4341-beee-f69633edd3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86346965d8964f999a71e5fbf527ca60, user_id=ba699ec9ad484db7bda04b6597c84822, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:46.899322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32b45a-af3e-406d-8120-3f1c64a26971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:46.899989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32b45a-af3e-406d-8120-3f1c64a26971 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:46.900274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32b45a-af3e-406d-8120-3f1c64a26971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:46.904759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32b45a-af3e-406d-8120-3f1c64a26971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:46.905278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbbb97-3a87-4341-beee-f69633edd3f8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:46.905473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32b45a-af3e-406d-8120-3f1c64a26971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:46.907469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32b45a-af3e-406d-8120-3f1c64a26971 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:46.940135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 888/1772] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:46 2022] PUT /identity/v3/projects/86346965d8964f999a71e5fbf527ca60/users/ba699ec9ad484db7bda04b6597c84822/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:46.940135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbbb97-3a87-4341-beee-f69633edd3f8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:46.949791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 885/1773] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:46.949791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205fc78-5771-4e7b-ac12-ae22f5ff6a38 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:46.949791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205fc78-5771-4e7b-ac12-ae22f5ff6a38 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:46.949791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205fc78-5771-4e7b-ac12-ae22f5ff6a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:46.993753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7205fc78-5771-4e7b-ac12-ae22f5ff6a38 None None] MFA Rules not processed for user `ba699ec9ad484db7bda04b6597c84822`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:46.995058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7205fc78-5771-4e7b-ac12-ae22f5ff6a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:47.025984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbbb97-3a87-4341-beee-f69633edd3f8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:47.032151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e1f1f-34c8-4849-8d3a-3c280d68f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:47.033464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e1f1f-34c8-4849-8d3a-3c280d68f55f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:47.033908 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e1f1f-34c8-4849-8d3a-3c280d68f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:47.036880 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e1f1f-34c8-4849-8d3a-3c280d68f55f admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:47.038505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e1f1f-34c8-4849-8d3a-3c280d68f55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:47.043602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e1f1f-34c8-4849-8d3a-3c280d68f55f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:47.057358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 889/1774] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:47.058638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e1f1f-34c8-4849-8d3a-3c280d68f55f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:47.073758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e1f1f-34c8-4849-8d3a-3c280d68f55f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:47.081197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21596d23-735a-4129-9ffc-282a33dc59ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:47.082525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21596d23-735a-4129-9ffc-282a33dc59ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:47.082801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21596d23-735a-4129-9ffc-282a33dc59ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:47.083077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21596d23-735a-4129-9ffc-282a33dc59ff admin admin] PATH_INFO: `/v3/projects/2514ff384d4449cc8f36d39de8dcf385/users/53849a9262514983bfaa229f757ad5e8/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:47.103657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21596d23-735a-4129-9ffc-282a33dc59ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2514ff384d4449cc8f36d39de8dcf385, user_id=53849a9262514983bfaa229f757ad5e8, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:47.107074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 886/1775] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:47.107396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21596d23-735a-4129-9ffc-282a33dc59ff admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:47.108188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205fc78-5771-4e7b-ac12-ae22f5ff6a38 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:47.120051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205fc78-5771-4e7b-ac12-ae22f5ff6a38 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:47.129720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:47.130467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007fc4-c9e8-4b1c-8748-9aa321936513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:47.130959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007fc4-c9e8-4b1c-8748-9aa321936513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:47.131108 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007fc4-c9e8-4b1c-8748-9aa321936513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:47.131383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007fc4-c9e8-4b1c-8748-9aa321936513 admin admin] PATH_INFO: `/v3/projects/ae34ade8569c4017a1161b832051297c/users/bdc35c443c55484097e1d34ff648c070/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:47.159347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91007fc4-c9e8-4b1c-8748-9aa321936513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae34ade8569c4017a1161b832051297c, user_id=bdc35c443c55484097e1d34ff648c070, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:47.166867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91007fc4-c9e8-4b1c-8748-9aa321936513 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:47.205495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:47.211191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 890/1776] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:47 2022] PUT /identity/v3/projects/2514ff384d4449cc8f36d39de8dcf385/users/53849a9262514983bfaa229f757ad5e8/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:47.215864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21596d23-735a-4129-9ffc-282a33dc59ff admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:47.293295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21596d23-735a-4129-9ffc-282a33dc59ff admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:47.301152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622462a-e6b5-4a4a-aeb6-d0d4eb19efd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:47.301868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622462a-e6b5-4a4a-aeb6-d0d4eb19efd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:47.302150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622462a-e6b5-4a4a-aeb6-d0d4eb19efd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:47.302474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622462a-e6b5-4a4a-aeb6-d0d4eb19efd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:47.324918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 887/1777] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:47 2022] PUT /identity/v3/projects/ae34ade8569c4017a1161b832051297c/users/bdc35c443c55484097e1d34ff648c070/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:47.326055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007fc4-c9e8-4b1c-8748-9aa321936513 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:47.420987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622462a-e6b5-4a4a-aeb6-d0d4eb19efd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:47.428561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622462a-e6b5-4a4a-aeb6-d0d4eb19efd4 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:47.466682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 891/1778] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:47.468539 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622462a-e6b5-4a4a-aeb6-d0d4eb19efd4 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:47.519543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007fc4-c9e8-4b1c-8748-9aa321936513 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:47.530522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693379b2-fb68-4e68-85c3-de0d6b7b4f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:47.531185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693379b2-fb68-4e68-85c3-de0d6b7b4f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:47.531511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693379b2-fb68-4e68-85c3-de0d6b7b4f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:47.531849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693379b2-fb68-4e68-85c3-de0d6b7b4f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:47.532603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693379b2-fb68-4e68-85c3-de0d6b7b4f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:47.534442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693379b2-fb68-4e68-85c3-de0d6b7b4f59 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:47.562297 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 888/1779] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:47.566374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693379b2-fb68-4e68-85c3-de0d6b7b4f59 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:47.586588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693379b2-fb68-4e68-85c3-de0d6b7b4f59 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:47.598884 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8677c-0181-4ae4-a6ca-ae6969d31d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:47.601475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8677c-0181-4ae4-a6ca-ae6969d31d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:47.603080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8677c-0181-4ae4-a6ca-ae6969d31d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:47.603382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8677c-0181-4ae4-a6ca-ae6969d31d74 admin admin] PATH_INFO: `/v3/projects/2514ff384d4449cc8f36d39de8dcf385/users/53849a9262514983bfaa229f757ad5e8/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:47.608833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8677c-0181-4ae4-a6ca-ae6969d31d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2514ff384d4449cc8f36d39de8dcf385, user_id=53849a9262514983bfaa229f757ad5e8, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:47.614979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8677c-0181-4ae4-a6ca-ae6969d31d74 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:47.651166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 889/1780] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:47 2022] PUT /identity/v3/projects/2514ff384d4449cc8f36d39de8dcf385/users/53849a9262514983bfaa229f757ad5e8/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:47.655564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569464-3076-4c43-bd01-b2bc408e93d1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:47.657255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569464-3076-4c43-bd01-b2bc408e93d1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:47.657578 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569464-3076-4c43-bd01-b2bc408e93d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:47.695523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6a569464-3076-4c43-bd01-b2bc408e93d1 None None] MFA Rules not processed for user `53849a9262514983bfaa229f757ad5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:47.700300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6a569464-3076-4c43-bd01-b2bc408e93d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:47.788791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622462a-e6b5-4a4a-aeb6-d0d4eb19efd4 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:47.848140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 890/1781] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:47 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:47.859699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:47.875168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a569464-3076-4c43-bd01-b2bc408e93d1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:47.935403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a6f06-2703-44a4-a8f5-522b7edcd550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:47.938200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a6f06-2703-44a4-a8f5-522b7edcd550 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:47.938666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a6f06-2703-44a4-a8f5-522b7edcd550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:47.939330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a6f06-2703-44a4-a8f5-522b7edcd550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:47.940220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a6f06-2703-44a4-a8f5-522b7edcd550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:47.942030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a6f06-2703-44a4-a8f5-522b7edcd550 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:47.993946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 892/1782] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:47.995001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a6f06-2703-44a4-a8f5-522b7edcd550 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:48.009166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a569464-3076-4c43-bd01-b2bc408e93d1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:48.022819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0637f-51f8-4dc7-a229-ea87a2ee4382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:48.023530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0637f-51f8-4dc7-a229-ea87a2ee4382 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:48.024049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0637f-51f8-4dc7-a229-ea87a2ee4382 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:48.024528 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0637f-51f8-4dc7-a229-ea87a2ee4382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:48.035593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0637f-51f8-4dc7-a229-ea87a2ee4382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:48.037885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0637f-51f8-4dc7-a229-ea87a2ee4382 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:48.050319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 891/1783] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:47 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:48.051298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0637f-51f8-4dc7-a229-ea87a2ee4382 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:48.073696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0637f-51f8-4dc7-a229-ea87a2ee4382 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:48.084942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87133a-d262-4106-9691-6a542409896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:48.086174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87133a-d262-4106-9691-6a542409896c admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:48.086452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87133a-d262-4106-9691-6a542409896c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:48.086723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87133a-d262-4106-9691-6a542409896c admin admin] PATH_INFO: `/v3/projects/ae34ade8569c4017a1161b832051297c/users/bdc35c443c55484097e1d34ff648c070/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:48.089488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87133a-d262-4106-9691-6a542409896c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae34ade8569c4017a1161b832051297c, user_id=bdc35c443c55484097e1d34ff648c070, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:48.089601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a6f06-2703-44a4-a8f5-522b7edcd550 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:48.092738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87133a-d262-4106-9691-6a542409896c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:48.093368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db7d67-a0a3-4d57-a9ed-f4933ed6fbe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:48.094834 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db7d67-a0a3-4d57-a9ed-f4933ed6fbe4 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:48.095118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db7d67-a0a3-4d57-a9ed-f4933ed6fbe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:48.095569 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db7d67-a0a3-4d57-a9ed-f4933ed6fbe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:48.113346 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 892/1784] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:48 2022] PUT /identity/v3/projects/ae34ade8569c4017a1161b832051297c/users/bdc35c443c55484097e1d34ff648c070/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:48.125280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230942f-4db6-4ced-afd8-1a569d46688f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:48.125778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230942f-4db6-4ced-afd8-1a569d46688f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:48.126648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230942f-4db6-4ced-afd8-1a569d46688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:48.160151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:48.173392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3230942f-4db6-4ced-afd8-1a569d46688f None None] MFA Rules not processed for user `bdc35c443c55484097e1d34ff648c070`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:48.174672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3230942f-4db6-4ced-afd8-1a569d46688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:48.197738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db7d67-a0a3-4d57-a9ed-f4933ed6fbe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:48.199195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db7d67-a0a3-4d57-a9ed-f4933ed6fbe4 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:48.210150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 893/1785] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:48.265696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db7d67-a0a3-4d57-a9ed-f4933ed6fbe4 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:48.292145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db7d67-a0a3-4d57-a9ed-f4933ed6fbe4 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:48.303258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 893/1786] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:31:48.423869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:48.425497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:48.426760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:48.426760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] PATH_INFO: `/v3/users/baffffd65a7c4f479a0fe218be4aa3b4` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:48.428199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baffffd65a7c4f479a0fe218be4aa3b4)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:48.430845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:48.651316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:48.705712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baffffd65a7c4f479a0fe218be4aa3b4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:48.730872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230942f-4db6-4ced-afd8-1a569d46688f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:48.765905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:48.782824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230942f-4db6-4ced-afd8-1a569d46688f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:48.786421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1aaff-eadf-489f-a4d3-4d3201dc0ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:48.787018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1aaff-eadf-489f-a4d3-4d3201dc0ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:48.787293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1aaff-eadf-489f-a4d3-4d3201dc0ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:48.787559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1aaff-eadf-489f-a4d3-4d3201dc0ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:48.789834 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baffffd65a7c4f479a0fe218be4aa3b4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:48.800873 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baffffd65a7c4f479a0fe218be4aa3b4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:48.803557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1aaff-eadf-489f-a4d3-4d3201dc0ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:48.805110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1aaff-eadf-489f-a4d3-4d3201dc0ee4 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:48.816795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 894/1787] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:31:48.828445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baffffd65a7c4f479a0fe218be4aa3b4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:48.880138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baffffd65a7c4f479a0fe218be4aa3b4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:48.888952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 894/1788] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:48 2022] DELETE /identity/v3/users/baffffd65a7c4f479a0fe218be4aa3b4 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:31:48.895537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558bf1d-c0e6-47d3-b244-4c3e49247016 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:48.895906 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558bf1d-c0e6-47d3-b244-4c3e49247016 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:48.896492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558bf1d-c0e6-47d3-b244-4c3e49247016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:48.920977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e558bf1d-c0e6-47d3-b244-4c3e49247016 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:48.922254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e558bf1d-c0e6-47d3-b244-4c3e49247016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:49.008616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 895/1789] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:49.019658 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:49.022638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:49.079899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558bf1d-c0e6-47d3-b244-4c3e49247016 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:49.081441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e558bf1d-c0e6-47d3-b244-4c3e49247016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:49.094941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:49.130615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2502-6e49-494d-b176-0190d5b514d1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:49.135046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b028-958f-4e96-aa66-f2e945f76d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:49.135760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b028-958f-4e96-aa66-f2e945f76d10 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:49.136128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b028-958f-4e96-aa66-f2e945f76d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:49.136471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b028-958f-4e96-aa66-f2e945f76d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:49.145748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0b028-958f-4e96-aa66-f2e945f76d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:49.147921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0b028-958f-4e96-aa66-f2e945f76d10 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:49.160205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 895/1790] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:49.161349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b028-958f-4e96-aa66-f2e945f76d10 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:49.162925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-40e0b028-958f-4e96-aa66-f2e945f76d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:49.181102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b028-958f-4e96-aa66-f2e945f76d10 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:49.182379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558bf1d-c0e6-47d3-b244-4c3e49247016 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:49.189223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:49.189881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:49.190171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:49.190430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] PATH_INFO: `/v3/users/5ef2d85fad94416e9e84d6aad07ddf72` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:49.191832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef2d85fad94416e9e84d6aad07ddf72)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:49.193806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:49.201031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51050d0-ee6e-4e53-b72c-652ee67a1b69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:49.201031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51050d0-ee6e-4e53-b72c-652ee67a1b69 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:49.201031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51050d0-ee6e-4e53-b72c-652ee67a1b69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:49.201031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51050d0-ee6e-4e53-b72c-652ee67a1b69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:49.201450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c51050d0-ee6e-4e53-b72c-652ee67a1b69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:49.315954 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51050d0-ee6e-4e53-b72c-652ee67a1b69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:49.317177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51050d0-ee6e-4e53-b72c-652ee67a1b69 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:49.343368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 896/1791] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:31:49.430783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:49.451650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef2d85fad94416e9e84d6aad07ddf72'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:49.542720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef2d85fad94416e9e84d6aad07ddf72'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:49.550176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef2d85fad94416e9e84d6aad07ddf72'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:49.550816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef2d85fad94416e9e84d6aad07ddf72'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:49.564934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef2d85fad94416e9e84d6aad07ddf72'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:49.573681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 896/1792] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:49 2022] DELETE /identity/v3/users/5ef2d85fad94416e9e84d6aad07ddf72 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:49.578010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6d722-6324-47b5-8a10-ab45bce930e2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:49.578301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6d722-6324-47b5-8a10-ab45bce930e2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:49.578598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6d722-6324-47b5-8a10-ab45bce930e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:49.600234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-bcf6d722-6324-47b5-8a10-ab45bce930e2 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:49.601677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bcf6d722-6324-47b5-8a10-ab45bce930e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:49.662209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 897/1793] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:49.672024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:49.673536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:49.703694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6d722-6324-47b5-8a10-ab45bce930e2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:49.705505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bcf6d722-6324-47b5-8a10-ab45bce930e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:49.724160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6d722-6324-47b5-8a10-ab45bce930e2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:49.730907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:49.731907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:49.732440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:49.733566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] PATH_INFO: `/v3/projects/07cdce4b5ca14a03b8e2d298bad0516e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:49.736039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=07cdce4b5ca14a03b8e2d298bad0516e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:49.738345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:49.759439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be04af-93d3-4570-aa18-a844be07ca2e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:49.764454 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc15c4-e44b-41e5-803f-d792d2986a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:49.766042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc15c4-e44b-41e5-803f-d792d2986a98 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:49.766334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc15c4-e44b-41e5-803f-d792d2986a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:49.766687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc15c4-e44b-41e5-803f-d792d2986a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:49.795521 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc15c4-e44b-41e5-803f-d792d2986a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:49.796686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc15c4-e44b-41e5-803f-d792d2986a98 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:49.826123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 897/1794] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:49.926223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07cdce4b5ca14a03b8e2d298bad0516e', 'request_id': 'req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:49.941686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07cdce4b5ca14a03b8e2d298bad0516e', 'request_id': 'req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:49.956859 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07cdce4b5ca14a03b8e2d298bad0516e', 'request_id': 'req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:49.978254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:50.074348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] The token cache is being invalidate because project 07cdce4b5ca14a03b8e2d298bad0516e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:50.074348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:50.074348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f023bd1-5fe8-467a-9d62-a3d88d13f0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:50.077649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 898/1795] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:49 2022] DELETE /identity/v3/projects/07cdce4b5ca14a03b8e2d298bad0516e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:50.077779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc15c4-e44b-41e5-803f-d792d2986a98 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:50.087581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc15c4-e44b-41e5-803f-d792d2986a98 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:50.227844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:50.228577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:50.229038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:50.229317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] PATH_INFO: `/v3/users/fb773d093c994fb6acc6e2ccd44e2028` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:50.235174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb773d093c994fb6acc6e2ccd44e2028)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:50.238223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:50.302356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f815737-7df9-41be-9d26-309b67ce4965 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:50.303047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f815737-7df9-41be-9d26-309b67ce4965 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:50.304193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f815737-7df9-41be-9d26-309b67ce4965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:50.416597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:50.483427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3f815737-7df9-41be-9d26-309b67ce4965 None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:50.486068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3f815737-7df9-41be-9d26-309b67ce4965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:50.493182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb773d093c994fb6acc6e2ccd44e2028'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:50.566076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb773d093c994fb6acc6e2ccd44e2028'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:50.576362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb773d093c994fb6acc6e2ccd44e2028'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:50.577120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb773d093c994fb6acc6e2ccd44e2028'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:50.601417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb773d093c994fb6acc6e2ccd44e2028'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:50.612516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 898/1796] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:50 2022] DELETE /identity/v3/users/fb773d093c994fb6acc6e2ccd44e2028 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:50.636954 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 899/1797] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:31:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:31:51.021496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:51.023612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:51.125797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:51.171126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f815737-7df9-41be-9d26-309b67ce4965 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:51.172788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3f815737-7df9-41be-9d26-309b67ce4965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:51.197639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f815737-7df9-41be-9d26-309b67ce4965 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:51.203849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b5e23-db79-4acb-9216-5870e87af54c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:51.216210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af4d68-153f-4e56-80ab-913c047984be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:51.216782 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af4d68-153f-4e56-80ab-913c047984be service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:51.217065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af4d68-153f-4e56-80ab-913c047984be service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:51.217686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af4d68-153f-4e56-80ab-913c047984be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:51.336816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:51.337493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:51.337777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:51.338054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] PATH_INFO: `/v3/projects/62951b6cd2004e309e1d622adbff9bea` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:51.339320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62951b6cd2004e309e1d622adbff9bea)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:51.339613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af4d68-153f-4e56-80ab-913c047984be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:51.341292 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:51.342604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af4d68-153f-4e56-80ab-913c047984be service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:51.380902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 899/1798] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:31:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:31:51.524941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62951b6cd2004e309e1d622adbff9bea', 'request_id': 'req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:51.533703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62951b6cd2004e309e1d622adbff9bea', 'request_id': 'req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:51.543605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62951b6cd2004e309e1d622adbff9bea', 'request_id': 'req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:51.669803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] The token cache is being invalidate because project 62951b6cd2004e309e1d622adbff9bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:51.670108 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:51.671275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:51.677904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 900/1799] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:51 2022] DELETE /identity/v3/projects/62951b6cd2004e309e1d622adbff9bea => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:31:51.679248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af4d68-153f-4e56-80ab-913c047984be service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:51.701830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af4d68-153f-4e56-80ab-913c047984be service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:51.771148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:51.806090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:51.918242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:51.918898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:51.919167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:51.919656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] PATH_INFO: `/v3/users/53849a9262514983bfaa229f757ad5e8` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:51.921226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53849a9262514983bfaa229f757ad5e8)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:51.923866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:52.242568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53849a9262514983bfaa229f757ad5e8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:52.328115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53849a9262514983bfaa229f757ad5e8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:52.341565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53849a9262514983bfaa229f757ad5e8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:52.346082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53849a9262514983bfaa229f757ad5e8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:52.377405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ea3aa3a3-6b4d-4040-bdd0-b167fdd9d2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53849a9262514983bfaa229f757ad5e8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:52.406286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 900/1800] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:51 2022] DELETE /identity/v3/users/53849a9262514983bfaa229f757ad5e8 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:52.599040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:52.600806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:52.671120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dba0-4926-411e-9022-e12ce9a2ccb7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:52.761234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:52.762293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:52.762981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:52.763389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] PATH_INFO: `/v3/projects/1225ab88936e4b698cb9df29d39755d4` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:52.765080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1225ab88936e4b698cb9df29d39755d4)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:52.767606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:52.822778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8ae4-7259-41b8-85ad-675d011b01ec None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:52.823060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8ae4-7259-41b8-85ad-675d011b01ec None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:52.823330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8ae4-7259-41b8-85ad-675d011b01ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:52.872082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-cf3b8ae4-7259-41b8-85ad-675d011b01ec None None] MFA Rules not processed for user `81bb83de9f794ac9b02e5dca2df3e4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:52.872082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cf3b8ae4-7259-41b8-85ad-675d011b01ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:52.940349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 901/1801] 10.222.0.30 () {58 vars in 1015 bytes} [Fri Sep 2 09:31:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:52.966604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b8ae4-7259-41b8-85ad-675d011b01ec None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:52.979612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cf3b8ae4-7259-41b8-85ad-675d011b01ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:53.000488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b8ae4-7259-41b8-85ad-675d011b01ec None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:53.011041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b403ec-780c-46c2-883d-dbe8b1f6c30d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:53.011564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b403ec-780c-46c2-883d-dbe8b1f6c30d service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:53.012042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b403ec-780c-46c2-883d-dbe8b1f6c30d service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:53.012467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b403ec-780c-46c2-883d-dbe8b1f6c30d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:53.024594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b403ec-780c-46c2-883d-dbe8b1f6c30d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:53.034336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b403ec-780c-46c2-883d-dbe8b1f6c30d service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:53.035620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 902/1802] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:53.216081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1225ab88936e4b698cb9df29d39755d4', 'request_id': 'req-1e407c0a-b321-47a8-8ff8-ea6921e4e549'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:53.228829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1225ab88936e4b698cb9df29d39755d4', 'request_id': 'req-1e407c0a-b321-47a8-8ff8-ea6921e4e549'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:53.242393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1225ab88936e4b698cb9df29d39755d4', 'request_id': 'req-1e407c0a-b321-47a8-8ff8-ea6921e4e549'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:53.262855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b403ec-780c-46c2-883d-dbe8b1f6c30d service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:53.269384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a1b403ec-780c-46c2-883d-dbe8b1f6c30d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:53.306541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b403ec-780c-46c2-883d-dbe8b1f6c30d service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:53.325901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:53.349235 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] The token cache is being invalidate because project 1225ab88936e4b698cb9df29d39755d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:53.349538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:53.353006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1e407c0a-b321-47a8-8ff8-ea6921e4e549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:53.359903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 901/1803] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:52 2022] DELETE /identity/v3/projects/1225ab88936e4b698cb9df29d39755d4 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:53.374192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe6d0f-45ef-45fe-af8b-c1e7abb04578 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:53.374520 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe6d0f-45ef-45fe-af8b-c1e7abb04578 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:53.374901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe6d0f-45ef-45fe-af8b-c1e7abb04578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:53.417007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-05fe6d0f-45ef-45fe-af8b-c1e7abb04578 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:53.437329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-05fe6d0f-45ef-45fe-af8b-c1e7abb04578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:53.570599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:53.571547 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:53.579205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:53.581799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] PATH_INFO: `/v3/projects/2514ff384d4449cc8f36d39de8dcf385` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:53.583378 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2514ff384d4449cc8f36d39de8dcf385)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:53.593157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:53.714013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 902/1804] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:53.723956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d99c7-1d66-4de2-ab35-1ef265bf9e83 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:53.724551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d99c7-1d66-4de2-ab35-1ef265bf9e83 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:53.730194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d99c7-1d66-4de2-ab35-1ef265bf9e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:53.762911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5f6d99c7-1d66-4de2-ab35-1ef265bf9e83 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:53.764530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5f6d99c7-1d66-4de2-ab35-1ef265bf9e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:53.776269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 903/1805] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:31:53.780831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d99c7-1d66-4de2-ab35-1ef265bf9e83 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:53.793678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d99c7-1d66-4de2-ab35-1ef265bf9e83 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:53.799693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287dd4c-71c3-4133-8698-049ee573054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:53.800725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287dd4c-71c3-4133-8698-049ee573054b admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:53.801212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287dd4c-71c3-4133-8698-049ee573054b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:53.801726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287dd4c-71c3-4133-8698-049ee573054b admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:53.802578 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287dd4c-71c3-4133-8698-049ee573054b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:53.803096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287dd4c-71c3-4133-8698-049ee573054b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:53.807054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287dd4c-71c3-4133-8698-049ee573054b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:53.863979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2514ff384d4449cc8f36d39de8dcf385', 'request_id': 'req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:53.869400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2514ff384d4449cc8f36d39de8dcf385', 'request_id': 'req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:53.877314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 904/1806] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:31:53.883639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287dd4c-71c3-4133-8698-049ee573054b admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:53.884566 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2514ff384d4449cc8f36d39de8dcf385', 'request_id': 'req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:53.897793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287dd4c-71c3-4133-8698-049ee573054b admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:54.008328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] The token cache is being invalidate because project 2514ff384d4449cc8f36d39de8dcf385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:31:54.014195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:54.014195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6c67fd0e-a5b9-4234-beb9-bdb005972ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:54.014195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 903/1807] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:31:53 2022] DELETE /identity/v3/projects/2514ff384d4449cc8f36d39de8dcf385 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:54.017327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70b395-b4ac-4232-8754-8006410b856a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:54.017631 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70b395-b4ac-4232-8754-8006410b856a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:54.020965 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70b395-b4ac-4232-8754-8006410b856a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:54.031233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:54.080989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ce70b395-b4ac-4232-8754-8006410b856a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:54.080989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ce70b395-b4ac-4232-8754-8006410b856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:54.112620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7b51e-1100-444c-a382-ff1aebc9b3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:54.113348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7b51e-1100-444c-a382-ff1aebc9b3cc admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:54.113726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7b51e-1100-444c-a382-ff1aebc9b3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:54.114167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7b51e-1100-444c-a382-ff1aebc9b3cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:54.115289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7b51e-1100-444c-a382-ff1aebc9b3cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:54.118461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7b51e-1100-444c-a382-ff1aebc9b3cc admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:54.190510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 904/1808] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:31:54.211487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f1116-0bae-4243-b5b3-98855fa6e224 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:54.211786 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f1116-0bae-4243-b5b3-98855fa6e224 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:54.212356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f1116-0bae-4243-b5b3-98855fa6e224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:54.252537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ad0f1116-0bae-4243-b5b3-98855fa6e224 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:54.257689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ad0f1116-0bae-4243-b5b3-98855fa6e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:54.264145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 905/1809] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:53 2022] POST /identity/v3/projects => generated 375 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:54.269982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7b51e-1100-444c-a382-ff1aebc9b3cc admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:54.280864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:54.283506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-20a7b51e-1100-444c-a382-ff1aebc9b3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:54.383986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 905/1810] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:54.385609 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f1116-0bae-4243-b5b3-98855fa6e224 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:54.432289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f1116-0bae-4243-b5b3-98855fa6e224 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:54.467362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf54c8-c602-4a30-afe6-b08163892fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:54.469173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf54c8-c602-4a30-afe6-b08163892fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:54.470316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf54c8-c602-4a30-afe6-b08163892fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:54.471594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf54c8-c602-4a30-afe6-b08163892fd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:54.474892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf54c8-c602-4a30-afe6-b08163892fd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:31:54.482155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf54c8-c602-4a30-afe6-b08163892fd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:54.482944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf54c8-c602-4a30-afe6-b08163892fd0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:54.532749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 906/1811] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:31:54.534528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf54c8-c602-4a30-afe6-b08163892fd0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:54.561355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf54c8-c602-4a30-afe6-b08163892fd0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:54.561355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3549385-19ec-4d39-9cc2-d9a4bbfbbb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:54.561754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549385-19ec-4d39-9cc2-d9a4bbfbbb3a admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:54.562036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549385-19ec-4d39-9cc2-d9a4bbfbbb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:54.562416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3549385-19ec-4d39-9cc2-d9a4bbfbbb3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:54.563058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3549385-19ec-4d39-9cc2-d9a4bbfbbb3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:54.565035 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3549385-19ec-4d39-9cc2-d9a4bbfbbb3a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:54.592809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7b51e-1100-444c-a382-ff1aebc9b3cc admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:54.598977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe0887-fbe4-4a82-b90d-48d15ac32380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:54.599707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe0887-fbe4-4a82-b90d-48d15ac32380 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:54.600155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe0887-fbe4-4a82-b90d-48d15ac32380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:54.600440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe0887-fbe4-4a82-b90d-48d15ac32380 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:54.601217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe0887-fbe4-4a82-b90d-48d15ac32380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:54.603427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe0887-fbe4-4a82-b90d-48d15ac32380 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:54.731914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 907/1812] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:54 2022] POST /identity/v3/projects => generated 363 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:54.735989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3549385-19ec-4d39-9cc2-d9a4bbfbbb3a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:54.744692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 906/1813] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:54 2022] POST /identity/v3/users => generated 288 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:54.759140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe0887-fbe4-4a82-b90d-48d15ac32380 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:54.820527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe0887-fbe4-4a82-b90d-48d15ac32380 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:54.873736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:54.882605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3549385-19ec-4d39-9cc2-d9a4bbfbbb3a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:54.889089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9677383-6006-4dc4-9e62-cef754cefb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:54.890676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9677383-6006-4dc4-9e62-cef754cefb3b admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:54.891144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9677383-6006-4dc4-9e62-cef754cefb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:54.891601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9677383-6006-4dc4-9e62-cef754cefb3b admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:54.892744 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9677383-6006-4dc4-9e62-cef754cefb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:54.895552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9677383-6006-4dc4-9e62-cef754cefb3b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:54.984215 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf143cf-01ef-4e11-86e4-fbe985b99c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:54.984717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf143cf-01ef-4e11-86e4-fbe985b99c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:54.985219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf143cf-01ef-4e11-86e4-fbe985b99c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:54.985368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf143cf-01ef-4e11-86e4-fbe985b99c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:54.986016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf143cf-01ef-4e11-86e4-fbe985b99c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:54.987979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf143cf-01ef-4e11-86e4-fbe985b99c5e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:55.013853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 908/1814] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:54 2022] POST /identity/v3/users => generated 282 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:55.015182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9677383-6006-4dc4-9e62-cef754cefb3b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:55.030035 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 907/1815] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:55.035096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf143cf-01ef-4e11-86e4-fbe985b99c5e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:55.039169 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9677383-6006-4dc4-9e62-cef754cefb3b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:55.059700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e16b24-c9ed-4f60-b11a-5799b73d460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:55.060671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e16b24-c9ed-4f60-b11a-5799b73d460d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:55.061162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e16b24-c9ed-4f60-b11a-5799b73d460d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:55.061666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e16b24-c9ed-4f60-b11a-5799b73d460d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:55.075981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e16b24-c9ed-4f60-b11a-5799b73d460d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:55.082098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e16b24-c9ed-4f60-b11a-5799b73d460d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:55.083177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf143cf-01ef-4e11-86e4-fbe985b99c5e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:55.097547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e2d6c-59f8-44de-830a-fa3b37bc311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:55.101095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e2d6c-59f8-44de-830a-fa3b37bc311d admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:55.101095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e2d6c-59f8-44de-830a-fa3b37bc311d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:55.101095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e2d6c-59f8-44de-830a-fa3b37bc311d admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:55.108086 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e2d6c-59f8-44de-830a-fa3b37bc311d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:55.112377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 909/1816] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:31:55.113458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e2d6c-59f8-44de-830a-fa3b37bc311d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:55.113863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e16b24-c9ed-4f60-b11a-5799b73d460d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:55.139810 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e16b24-c9ed-4f60-b11a-5799b73d460d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:55.151767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e3564-0715-4115-b17f-de23188a03cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:55.153320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e3564-0715-4115-b17f-de23188a03cf admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:55.155305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e3564-0715-4115-b17f-de23188a03cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:55.155832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e3564-0715-4115-b17f-de23188a03cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:55.157303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e3564-0715-4115-b17f-de23188a03cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:55.164930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 908/1817] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:55.172070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e2d6c-59f8-44de-830a-fa3b37bc311d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:55.172941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e3564-0715-4115-b17f-de23188a03cf admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:55.193542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e2d6c-59f8-44de-830a-fa3b37bc311d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:55.206654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8894e-ef6f-4dd6-8c10-377c39940d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:55.207673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8894e-ef6f-4dd6-8c10-377c39940d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:55.208001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8894e-ef6f-4dd6-8c10-377c39940d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:55.208406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8894e-ef6f-4dd6-8c10-377c39940d47 admin admin] PATH_INFO: `/v3/projects/afbb997c85284c62ab7f7857fad91d6f/users/950495fc245b4e35ab01e56ce02f2154/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:55.222952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 910/1818] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:55.232486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e3564-0715-4115-b17f-de23188a03cf admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:55.252843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8894e-ef6f-4dd6-8c10-377c39940d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbb997c85284c62ab7f7857fad91d6f, user_id=950495fc245b4e35ab01e56ce02f2154, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:55.261199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8894e-ef6f-4dd6-8c10-377c39940d47 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:55.261334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e3564-0715-4115-b17f-de23188a03cf admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:55.265998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84820-21a2-4e0e-a62f-4fea541e741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:55.267406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84820-21a2-4e0e-a62f-4fea541e741b admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:55.267406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84820-21a2-4e0e-a62f-4fea541e741b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:55.267618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84820-21a2-4e0e-a62f-4fea541e741b admin admin] PATH_INFO: `/v3/projects/2fe180b0ff514e2788ba2ab6ee6600d4/users/9e354e0ebdac4a4bac8c7661bc4c9f74/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:55.291731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b84820-21a2-4e0e-a62f-4fea541e741b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe180b0ff514e2788ba2ab6ee6600d4, user_id=9e354e0ebdac4a4bac8c7661bc4c9f74, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:55.291731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b84820-21a2-4e0e-a62f-4fea541e741b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:55.371932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 909/1819] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:55 2022] PUT /identity/v3/projects/afbb997c85284c62ab7f7857fad91d6f/users/950495fc245b4e35ab01e56ce02f2154/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:55.381003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd41b51-a56c-44b7-bafa-39fc2d19dbf7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:55.381285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd41b51-a56c-44b7-bafa-39fc2d19dbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:55.381670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd41b51-a56c-44b7-bafa-39fc2d19dbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:55.397668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 911/1820] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:55 2022] PUT /identity/v3/projects/2fe180b0ff514e2788ba2ab6ee6600d4/users/9e354e0ebdac4a4bac8c7661bc4c9f74/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:31:55.409012 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad70c8-b4a3-4e65-9dc6-59a97f805699 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:55.409012 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad70c8-b4a3-4e65-9dc6-59a97f805699 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:55.409012 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad70c8-b4a3-4e65-9dc6-59a97f805699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:55.465740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-97ad70c8-b4a3-4e65-9dc6-59a97f805699 None None] MFA Rules not processed for user `9e354e0ebdac4a4bac8c7661bc4c9f74`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:55.467649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-97ad70c8-b4a3-4e65-9dc6-59a97f805699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:55.472230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4bd41b51-a56c-44b7-bafa-39fc2d19dbf7 None None] MFA Rules not processed for user `950495fc245b4e35ab01e56ce02f2154`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:55.472230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4bd41b51-a56c-44b7-bafa-39fc2d19dbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:55.592571 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 910/1821] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:55.598317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd41b51-a56c-44b7-bafa-39fc2d19dbf7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:55.617779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 912/1822] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:31:55.622465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad70c8-b4a3-4e65-9dc6-59a97f805699 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:55.762217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad70c8-b4a3-4e65-9dc6-59a97f805699 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:55.780264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92999593-1e4b-449f-8291-4f0a67c1c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:55.781102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92999593-1e4b-449f-8291-4f0a67c1c97f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:55.782195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92999593-1e4b-449f-8291-4f0a67c1c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:55.788542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92999593-1e4b-449f-8291-4f0a67c1c97f admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:55.788542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92999593-1e4b-449f-8291-4f0a67c1c97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:55.788542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92999593-1e4b-449f-8291-4f0a67c1c97f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:55.814101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd41b51-a56c-44b7-bafa-39fc2d19dbf7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:55.823677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248e71c-55c5-496e-aa34-eb18903e16a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:55.824857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248e71c-55c5-496e-aa34-eb18903e16a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:55.824857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248e71c-55c5-496e-aa34-eb18903e16a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:55.825315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248e71c-55c5-496e-aa34-eb18903e16a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:55.834130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248e71c-55c5-496e-aa34-eb18903e16a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:55.838146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248e71c-55c5-496e-aa34-eb18903e16a2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:55.892713 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:55.945589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 913/1823] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:55 2022] POST /identity/v3/projects => generated 363 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:31:55.948328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56a81d-1096-4d54-9a64-95a755e00c14 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:55.949763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56a81d-1096-4d54-9a64-95a755e00c14 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:55.953791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 911/1824] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:31:55 2022] POST /identity/v3/projects => generated 375 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:55.953974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56a81d-1096-4d54-9a64-95a755e00c14 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:55.954104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248e71c-55c5-496e-aa34-eb18903e16a2 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:55.956815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 914/1825] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:31:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:31:55.958790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56a81d-1096-4d54-9a64-95a755e00c14 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:55.998125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:56.110622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248e71c-55c5-496e-aa34-eb18903e16a2 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:56.152247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65370870-3e6f-45e5-a4bf-074941785925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:56.154611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65370870-3e6f-45e5-a4bf-074941785925 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:56.154611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65370870-3e6f-45e5-a4bf-074941785925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:56.154822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65370870-3e6f-45e5-a4bf-074941785925 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:56.155463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65370870-3e6f-45e5-a4bf-074941785925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:56.169894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65370870-3e6f-45e5-a4bf-074941785925 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:56.238207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56a81d-1096-4d54-9a64-95a755e00c14 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:56.258605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c8e86-5455-4971-b3be-1763356a5ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:56.259651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8e86-5455-4971-b3be-1763356a5ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:56.260420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8e86-5455-4971-b3be-1763356a5ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:56.260702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8e86-5455-4971-b3be-1763356a5ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:56.262361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c8e86-5455-4971-b3be-1763356a5ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:56.269239 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c8e86-5455-4971-b3be-1763356a5ff0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:56.291515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 912/1826] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:55 2022] POST /identity/v3/users => generated 288 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:56.297921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a912da-c585-4a80-9c71-a7a6901dfe39 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:56.297921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a912da-c585-4a80-9c71-a7a6901dfe39 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:56.297921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a912da-c585-4a80-9c71-a7a6901dfe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:56.351775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a0a912da-c585-4a80-9c71-a7a6901dfe39 None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:56.359314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a0a912da-c585-4a80-9c71-a7a6901dfe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:56.426626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 915/1827] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:31:55 2022] POST /identity/v3/users => generated 294 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:31:56.426626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c8e86-5455-4971-b3be-1763356a5ff0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:56.451105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c8e86-5455-4971-b3be-1763356a5ff0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:56.462181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09236e5e-0974-450e-beb2-94a68b55110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:56.463356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236e5e-0974-450e-beb2-94a68b55110e admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:56.468778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236e5e-0974-450e-beb2-94a68b55110e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:56.470625 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236e5e-0974-450e-beb2-94a68b55110e admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:56.471536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09236e5e-0974-450e-beb2-94a68b55110e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:56.482795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09236e5e-0974-450e-beb2-94a68b55110e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:56.514620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 916/1828] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:56.533491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e68c3-0969-41ed-961c-53e8bac9588e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:56.533821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e68c3-0969-41ed-961c-53e8bac9588e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:56.534094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e68c3-0969-41ed-961c-53e8bac9588e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:56.535469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 917/1829] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:31:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:31:56.536235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e68c3-0969-41ed-961c-53e8bac9588e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:56.557957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 913/1830] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:31:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:56.559657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a912da-c585-4a80-9c71-a7a6901dfe39 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:56.566921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e68c3-0969-41ed-961c-53e8bac9588e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:56.574155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a912da-c585-4a80-9c71-a7a6901dfe39 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:56.578408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c746-60dd-4850-af73-e7dcd855f5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:56.579090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c746-60dd-4850-af73-e7dcd855f5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:56.579370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c746-60dd-4850-af73-e7dcd855f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:56.579661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c746-60dd-4850-af73-e7dcd855f5a5 admin admin] PATH_INFO: `/v3/projects/aa338d60bdf548db87b84fa271aa0cdd/users/e7fa03a06efa40e78f20b62fa6368d57/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:56.581904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a5d1f-bdb2-4d0f-92e0-44a521d9816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:56.582759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a5d1f-bdb2-4d0f-92e0-44a521d9816a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:56.583202 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a5d1f-bdb2-4d0f-92e0-44a521d9816a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:56.583688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a5d1f-bdb2-4d0f-92e0-44a521d9816a admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:56.584640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a5d1f-bdb2-4d0f-92e0-44a521d9816a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:56.586642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a5d1f-bdb2-4d0f-92e0-44a521d9816a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:56.611737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 918/1831] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:56.612495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71c746-60dd-4850-af73-e7dcd855f5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa338d60bdf548db87b84fa271aa0cdd, user_id=e7fa03a06efa40e78f20b62fa6368d57, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:56.615313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71c746-60dd-4850-af73-e7dcd855f5a5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:56.616984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a5d1f-bdb2-4d0f-92e0-44a521d9816a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:56.638106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a5d1f-bdb2-4d0f-92e0-44a521d9816a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:56.644301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb18ec9-d1fc-4363-a1d3-81f3e82bb7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:56.645249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb18ec9-d1fc-4363-a1d3-81f3e82bb7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:56.646475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb18ec9-d1fc-4363-a1d3-81f3e82bb7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:56.646475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb18ec9-d1fc-4363-a1d3-81f3e82bb7d5 admin admin] PATH_INFO: `/v3/projects/810cd2860c0a4d6c8c9086a70d18ea12/users/b28bf78ca97547cf8a00ed08e10e036c/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:56.692902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb18ec9-d1fc-4363-a1d3-81f3e82bb7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810cd2860c0a4d6c8c9086a70d18ea12, user_id=b28bf78ca97547cf8a00ed08e10e036c, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:56.695836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb18ec9-d1fc-4363-a1d3-81f3e82bb7d5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:56.734191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 914/1832] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:56 2022] PUT /identity/v3/projects/aa338d60bdf548db87b84fa271aa0cdd/users/e7fa03a06efa40e78f20b62fa6368d57/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:56.739821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02fed4-5b0d-47a8-abb0-77df73bd097d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:56.745455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02fed4-5b0d-47a8-abb0-77df73bd097d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:56.750326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02fed4-5b0d-47a8-abb0-77df73bd097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:56.768877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 919/1833] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:56 2022] PUT /identity/v3/projects/810cd2860c0a4d6c8c9086a70d18ea12/users/b28bf78ca97547cf8a00ed08e10e036c/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:56.769896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb18ec9-d1fc-4363-a1d3-81f3e82bb7d5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:56.845042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:56.853748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1e02fed4-5b0d-47a8-abb0-77df73bd097d None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:56.857131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1e02fed4-5b0d-47a8-abb0-77df73bd097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:56.972980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb18ec9-d1fc-4363-a1d3-81f3e82bb7d5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:56.993009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664681d6-48c1-4942-8115-573331131c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:56.993814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664681d6-48c1-4942-8115-573331131c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:56.995173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664681d6-48c1-4942-8115-573331131c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:56.995674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664681d6-48c1-4942-8115-573331131c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:56.997138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664681d6-48c1-4942-8115-573331131c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:56.999583 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664681d6-48c1-4942-8115-573331131c6d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:57.026781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 920/1834] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:57.028190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664681d6-48c1-4942-8115-573331131c6d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:57.042659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 915/1835] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:31:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:57.050211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-664681d6-48c1-4942-8115-573331131c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:57.051145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02fed4-5b0d-47a8-abb0-77df73bd097d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:57.072341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02fed4-5b0d-47a8-abb0-77df73bd097d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:57.086487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efd71e-969b-4c24-8a41-0b428ceb573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:57.087119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efd71e-969b-4c24-8a41-0b428ceb573a admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:57.087395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efd71e-969b-4c24-8a41-0b428ceb573a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:57.087669 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efd71e-969b-4c24-8a41-0b428ceb573a admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:57.088362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efd71e-969b-4c24-8a41-0b428ceb573a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:57.089968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efd71e-969b-4c24-8a41-0b428ceb573a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:57.094525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664681d6-48c1-4942-8115-573331131c6d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:57.113238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067add6c-fa3d-45cf-b2f9-489cc4b8ac51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:57.114232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067add6c-fa3d-45cf-b2f9-489cc4b8ac51 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:57.115072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 916/1836] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:31:57.115575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067add6c-fa3d-45cf-b2f9-489cc4b8ac51 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:57.116719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efd71e-969b-4c24-8a41-0b428ceb573a admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:57.118482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067add6c-fa3d-45cf-b2f9-489cc4b8ac51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:57.144163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067add6c-fa3d-45cf-b2f9-489cc4b8ac51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:57.148219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067add6c-fa3d-45cf-b2f9-489cc4b8ac51 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:57.164974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efd71e-969b-4c24-8a41-0b428ceb573a admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:57.182676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 921/1837] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:57.182676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067add6c-fa3d-45cf-b2f9-489cc4b8ac51 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:57.197505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f60de-11c5-4c0a-a538-9ba58d5e2e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:57.204285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f60de-11c5-4c0a-a538-9ba58d5e2e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:57.209538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f60de-11c5-4c0a-a538-9ba58d5e2e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:57.209538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f60de-11c5-4c0a-a538-9ba58d5e2e10 admin admin] PATH_INFO: `/v3/projects/aa338d60bdf548db87b84fa271aa0cdd/users/e7fa03a06efa40e78f20b62fa6368d57/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:57.209758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067add6c-fa3d-45cf-b2f9-489cc4b8ac51 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:57.217413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6a210-3d82-489f-b243-a954c975e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:57.219008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f60de-11c5-4c0a-a538-9ba58d5e2e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa338d60bdf548db87b84fa271aa0cdd, user_id=e7fa03a06efa40e78f20b62fa6368d57, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:57.219238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6a210-3d82-489f-b243-a954c975e422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:57.219562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6a210-3d82-489f-b243-a954c975e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:57.220008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6a210-3d82-489f-b243-a954c975e422 admin admin] PATH_INFO: `/v3/projects/810cd2860c0a4d6c8c9086a70d18ea12/users/b28bf78ca97547cf8a00ed08e10e036c/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:57.223288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6a210-3d82-489f-b243-a954c975e422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810cd2860c0a4d6c8c9086a70d18ea12, user_id=b28bf78ca97547cf8a00ed08e10e036c, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:57.225636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f60de-11c5-4c0a-a538-9ba58d5e2e10 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:57.229539 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6a210-3d82-489f-b243-a954c975e422 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:57.318142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 922/1838] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:57 2022] PUT /identity/v3/projects/810cd2860c0a4d6c8c9086a70d18ea12/users/b28bf78ca97547cf8a00ed08e10e036c/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:57.319295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6a210-3d82-489f-b243-a954c975e422 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:57.329084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 917/1839] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:31:57 2022] PUT /identity/v3/projects/aa338d60bdf548db87b84fa271aa0cdd/users/e7fa03a06efa40e78f20b62fa6368d57/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:57.348928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a3d74-ff0f-4e4c-bc40-1f5d36abba8c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:57.348928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a3d74-ff0f-4e4c-bc40-1f5d36abba8c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:57.348928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a3d74-ff0f-4e4c-bc40-1f5d36abba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:57.390832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:57.468094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a99a3d74-ff0f-4e4c-bc40-1f5d36abba8c None None] MFA Rules not processed for user `b28bf78ca97547cf8a00ed08e10e036c`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:57.468906 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a99a3d74-ff0f-4e4c-bc40-1f5d36abba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:57.583635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6a210-3d82-489f-b243-a954c975e422 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:57.651732 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 918/1840] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:57.664024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a3d74-ff0f-4e4c-bc40-1f5d36abba8c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:57.670891 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a99a3d74-ff0f-4e4c-bc40-1f5d36abba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:57.814088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a3d74-ff0f-4e4c-bc40-1f5d36abba8c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:57.825092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2bbec-5213-4156-9f2b-879f5b9c4ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:57.825742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2bbec-5213-4156-9f2b-879f5b9c4ecd service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:57.835086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2bbec-5213-4156-9f2b-879f5b9c4ecd service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:57.835086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2bbec-5213-4156-9f2b-879f5b9c4ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:57.835507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:57.835507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:57.835507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:57.835507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] PATH_INFO: `/v3/users/a7931115c769434586d62900065afe93` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:57.835809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7931115c769434586d62900065afe93)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:57.844674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2bbec-5213-4156-9f2b-879f5b9c4ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:57.846479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2bbec-5213-4156-9f2b-879f5b9c4ecd service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:57.849691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:57.876990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 923/1841] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:57.878671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56bcd6-7fd5-4d47-9dbd-2479cd594530 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:57.882973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56bcd6-7fd5-4d47-9dbd-2479cd594530 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:57.887346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56bcd6-7fd5-4d47-9dbd-2479cd594530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:57.987751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3c56bcd6-7fd5-4d47-9dbd-2479cd594530 None None] MFA Rules not processed for user `e7fa03a06efa40e78f20b62fa6368d57`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:57.991596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3c56bcd6-7fd5-4d47-9dbd-2479cd594530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:58.163977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7931115c769434586d62900065afe93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:58.164829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7931115c769434586d62900065afe93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:58.177956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 924/1842] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:58.179073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56bcd6-7fd5-4d47-9dbd-2479cd594530 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:58.185844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3c56bcd6-7fd5-4d47-9dbd-2479cd594530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:58.215359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7931115c769434586d62900065afe93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:58.223769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7931115c769434586d62900065afe93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:58.288762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7931115c769434586d62900065afe93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:31:58.322587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 919/1843] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:31:57 2022] DELETE /identity/v3/users/a7931115c769434586d62900065afe93 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:31:58.322587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:58.326760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:58.370667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56bcd6-7fd5-4d47-9dbd-2479cd594530 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:58.449190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa6db-2b44-4f50-8cfb-efe9f30675f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:58.450468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa6db-2b44-4f50-8cfb-efe9f30675f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:58.451088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa6db-2b44-4f50-8cfb-efe9f30675f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:58.452446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa6db-2b44-4f50-8cfb-efe9f30675f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:58.457515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-be7fa6db-2b44-4f50-8cfb-efe9f30675f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:58.479829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc43884-b0d8-4d94-93a9-18756ece07d2 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:58.498431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8c53-9c70-4b8e-beef-324b057a5651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:58.499713 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8c53-9c70-4b8e-beef-324b057a5651 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:58.500209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8c53-9c70-4b8e-beef-324b057a5651 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:58.500686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8c53-9c70-4b8e-beef-324b057a5651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:58.506600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e14d8c53-9c70-4b8e-beef-324b057a5651 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:58.639408 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa6db-2b44-4f50-8cfb-efe9f30675f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:58.644815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa6db-2b44-4f50-8cfb-efe9f30675f0 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:58.657407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d8c53-9c70-4b8e-beef-324b057a5651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:58.660102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d8c53-9c70-4b8e-beef-324b057a5651 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:58.669845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 925/1844] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:58.673626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d9dc6-d7d1-4e33-aff8-3056a50631d1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:58.674470 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d9dc6-d7d1-4e33-aff8-3056a50631d1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:58.675787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d9dc6-d7d1-4e33-aff8-3056a50631d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:58.693941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 920/1845] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:58.742310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-026d9dc6-d7d1-4e33-aff8-3056a50631d1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:31:58.744649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-026d9dc6-d7d1-4e33-aff8-3056a50631d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:58.880998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 926/1846] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:31:58.947784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8c53-9c70-4b8e-beef-324b057a5651 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:58.949357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e14d8c53-9c70-4b8e-beef-324b057a5651 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:59.042347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d9dc6-d7d1-4e33-aff8-3056a50631d1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:31:59.061430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d9dc6-d7d1-4e33-aff8-3056a50631d1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:59.065784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56dc0d-4929-4a81-b450-5107fe1e23c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:59.066579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56dc0d-4929-4a81-b450-5107fe1e23c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:59.066921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56dc0d-4929-4a81-b450-5107fe1e23c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:59.067298 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56dc0d-4929-4a81-b450-5107fe1e23c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:59.071298 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6e56dc0d-4929-4a81-b450-5107fe1e23c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:31:59.072315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8c53-9c70-4b8e-beef-324b057a5651 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:31:59.081706 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1910820-da82-4240-a633-585f94f45194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:31:59.082433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1910820-da82-4240-a633-585f94f45194 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:31:59.082715 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1910820-da82-4240-a633-585f94f45194 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:31:59.083072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1910820-da82-4240-a633-585f94f45194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:31:59.110177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1910820-da82-4240-a633-585f94f45194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:59.111800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1910820-da82-4240-a633-585f94f45194 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:59.137771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 921/1847] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:59.207772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56dc0d-4929-4a81-b450-5107fe1e23c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:31:59.209264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56dc0d-4929-4a81-b450-5107fe1e23c2 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:31:59.223684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 927/1848] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:31:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:31:59.241615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:31:59.360282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:00.197252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1910820-da82-4240-a633-585f94f45194 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:00.201042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e1910820-da82-4240-a633-585f94f45194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:00.218993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1910820-da82-4240-a633-585f94f45194 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:00.239124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:00.241230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:00.242332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:00.242857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] PATH_INFO: `/v3/projects/7ba5fc7c78f7431b9d7aa96de70ee97e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:00.244275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba5fc7c78f7431b9d7aa96de70ee97e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:00.247461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:00.397262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba5fc7c78f7431b9d7aa96de70ee97e', 'request_id': 'req-852d9028-81ed-437e-b4df-e840b1334acb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:00.420508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba5fc7c78f7431b9d7aa96de70ee97e', 'request_id': 'req-852d9028-81ed-437e-b4df-e840b1334acb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:00.429392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba5fc7c78f7431b9d7aa96de70ee97e', 'request_id': 'req-852d9028-81ed-437e-b4df-e840b1334acb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:00.550813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] The token cache is being invalidate because project 7ba5fc7c78f7431b9d7aa96de70ee97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:00.551450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:00.552370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:00.565746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 922/1849] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:00 2022] DELETE /identity/v3/projects/7ba5fc7c78f7431b9d7aa96de70ee97e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:00.569987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56dc0d-4929-4a81-b450-5107fe1e23c2 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:00.583147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56dc0d-4929-4a81-b450-5107fe1e23c2 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:00.652336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:00.653225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:00.653595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:00.654101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] PATH_INFO: `/v3/users/bdc35c443c55484097e1d34ff648c070` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:00.655464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc35c443c55484097e1d34ff648c070)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:00.657760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:00.913929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc35c443c55484097e1d34ff648c070'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:00.983326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc35c443c55484097e1d34ff648c070'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:01.003052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc35c443c55484097e1d34ff648c070'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:01.004252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc35c443c55484097e1d34ff648c070'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:01.029336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3b79bffd-d806-4c35-8eab-3954c07ca85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc35c443c55484097e1d34ff648c070'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:01.041172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 928/1850] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:00 2022] DELETE /identity/v3/users/bdc35c443c55484097e1d34ff648c070 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:02.068957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:02.070310 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:02.071969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:02.140159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9028-81ed-437e-b4df-e840b1334acb admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:02.345720 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:02.346402 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:02.346677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:02.347031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] PATH_INFO: `/v3/projects/ae34ade8569c4017a1161b832051297c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:02.357963 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae34ade8569c4017a1161b832051297c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:02.366255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:02.579862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae34ade8569c4017a1161b832051297c', 'request_id': 'req-991f042c-59f0-44c8-93c7-6156da8a62c9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:02.585682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae34ade8569c4017a1161b832051297c', 'request_id': 'req-991f042c-59f0-44c8-93c7-6156da8a62c9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:02.592085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae34ade8569c4017a1161b832051297c', 'request_id': 'req-991f042c-59f0-44c8-93c7-6156da8a62c9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:02.686558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] The token cache is being invalidate because project ae34ade8569c4017a1161b832051297c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:02.686853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:02.687479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:02.689155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 923/1851] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:02 2022] DELETE /identity/v3/projects/ae34ade8569c4017a1161b832051297c => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:02.694129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125617-3193-4d2f-bf40-7bb875857068 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:02.695159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125617-3193-4d2f-bf40-7bb875857068 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:02.695632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125617-3193-4d2f-bf40-7bb875857068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:02.718242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8d125617-3193-4d2f-bf40-7bb875857068 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:02.719431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8d125617-3193-4d2f-bf40-7bb875857068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:02.775588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:02.777064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:02.810242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 929/1852] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:02.819653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249c2e9-af00-4827-830d-08e648d94cdf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:02.820283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249c2e9-af00-4827-830d-08e648d94cdf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:02.823107 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:02.824048 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249c2e9-af00-4827-830d-08e648d94cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:02.860306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9249c2e9-af00-4827-830d-08e648d94cdf None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:02.861743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9249c2e9-af00-4827-830d-08e648d94cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:02.873553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 930/1853] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:02.877456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249c2e9-af00-4827-830d-08e648d94cdf None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:02.886500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f042c-59f0-44c8-93c7-6156da8a62c9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:02.890188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e800d-438c-428e-b8f2-841318c9a22e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:02.890380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249c2e9-af00-4827-830d-08e648d94cdf None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:02.890798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e800d-438c-428e-b8f2-841318c9a22e service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:02.891091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e800d-438c-428e-b8f2-841318c9a22e service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:02.891347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e800d-438c-428e-b8f2-841318c9a22e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:02.893227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c31e800d-438c-428e-b8f2-841318c9a22e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:02.896424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07290-f38d-4a72-b552-3b3d308647fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:02.897135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07290-f38d-4a72-b552-3b3d308647fb admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:02.897520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07290-f38d-4a72-b552-3b3d308647fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:02.897789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07290-f38d-4a72-b552-3b3d308647fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:02.898521 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07290-f38d-4a72-b552-3b3d308647fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:02.898811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07290-f38d-4a72-b552-3b3d308647fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:02.900745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07290-f38d-4a72-b552-3b3d308647fb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:02.916603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 931/1854] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:32:02.921115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07290-f38d-4a72-b552-3b3d308647fb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:02.939311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07290-f38d-4a72-b552-3b3d308647fb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:02.954639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a54813-ea84-4eaf-b4a5-5a0385b27654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:02.955364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a54813-ea84-4eaf-b4a5-5a0385b27654 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:02.958749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a54813-ea84-4eaf-b4a5-5a0385b27654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:02.958749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a54813-ea84-4eaf-b4a5-5a0385b27654 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:02.958749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a54813-ea84-4eaf-b4a5-5a0385b27654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:02.958749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a54813-ea84-4eaf-b4a5-5a0385b27654 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:02.986277 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e800d-438c-428e-b8f2-841318c9a22e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:02.988041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e800d-438c-428e-b8f2-841318c9a22e service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:03.000738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 924/1855] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:03.090406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 932/1856] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:02 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:03.107709 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e800d-438c-428e-b8f2-841318c9a22e service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:03.129222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e800d-438c-428e-b8f2-841318c9a22e service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:03.257039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789d678-2df2-439d-a771-560c9e6c6780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:03.258278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d678-2df2-439d-a771-560c9e6c6780 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:03.258809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d678-2df2-439d-a771-560c9e6c6780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:03.259399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d678-2df2-439d-a771-560c9e6c6780 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:03.260388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789d678-2df2-439d-a771-560c9e6c6780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:03.263807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789d678-2df2-439d-a771-560c9e6c6780 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:03.363291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a54813-ea84-4eaf-b4a5-5a0385b27654 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:03.374347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 925/1857] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:03 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:03.384235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a54813-ea84-4eaf-b4a5-5a0385b27654 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:03.392978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc50f-7ac4-4de0-857d-bacec73e363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:03.394619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc50f-7ac4-4de0-857d-bacec73e363f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:03.395098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc50f-7ac4-4de0-857d-bacec73e363f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:03.395508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc50f-7ac4-4de0-857d-bacec73e363f admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:03.396380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fc50f-7ac4-4de0-857d-bacec73e363f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:03.398914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fc50f-7ac4-4de0-857d-bacec73e363f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:03.414153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 933/1858] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:03.419211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789d678-2df2-439d-a771-560c9e6c6780 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:03.430219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789d678-2df2-439d-a771-560c9e6c6780 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:03.436378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b75ee-d75a-4d42-987c-fc901979755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:03.437453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b75ee-d75a-4d42-987c-fc901979755c admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:03.437799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b75ee-d75a-4d42-987c-fc901979755c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:03.438131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b75ee-d75a-4d42-987c-fc901979755c admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:03.438862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b75ee-d75a-4d42-987c-fc901979755c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:03.441329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b75ee-d75a-4d42-987c-fc901979755c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:03.457066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 926/1859] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:03.461957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc50f-7ac4-4de0-857d-bacec73e363f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:03.488937 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc50f-7ac4-4de0-857d-bacec73e363f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:03.499422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961c6d0-aa57-4d92-a801-539f5a8e69ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:03.501507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961c6d0-aa57-4d92-a801-539f5a8e69ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:03.502344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961c6d0-aa57-4d92-a801-539f5a8e69ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:03.502861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961c6d0-aa57-4d92-a801-539f5a8e69ea admin admin] PATH_INFO: `/v3/projects/c5493f7e62384a319cf90cbecb721d09/users/36e81e154caa4bc58b6395dfd7af3c86/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:03.535982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961c6d0-aa57-4d92-a801-539f5a8e69ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5493f7e62384a319cf90cbecb721d09, user_id=36e81e154caa4bc58b6395dfd7af3c86, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:03.539756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961c6d0-aa57-4d92-a801-539f5a8e69ea admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:03.642603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 934/1860] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:03 2022] PUT /identity/v3/projects/c5493f7e62384a319cf90cbecb721d09/users/36e81e154caa4bc58b6395dfd7af3c86/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:03.655237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630ce3b-4e98-473d-9c1b-24782f96e384 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:03.655650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630ce3b-4e98-473d-9c1b-24782f96e384 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:03.656159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630ce3b-4e98-473d-9c1b-24782f96e384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:03.690951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d630ce3b-4e98-473d-9c1b-24782f96e384 None None] MFA Rules not processed for user `36e81e154caa4bc58b6395dfd7af3c86`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:03.693408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d630ce3b-4e98-473d-9c1b-24782f96e384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:03.754219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961c6d0-aa57-4d92-a801-539f5a8e69ea admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:03.761761 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0961c6d0-aa57-4d92-a801-539f5a8e69ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:03.804630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 927/1861] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:03.805637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630ce3b-4e98-473d-9c1b-24782f96e384 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:03.810140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d630ce3b-4e98-473d-9c1b-24782f96e384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:03.910684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961c6d0-aa57-4d92-a801-539f5a8e69ea admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:03.922359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:03.923189 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:03.923470 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:03.924211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] PATH_INFO: `/v3/users/9e354e0ebdac4a4bac8c7661bc4c9f74` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:03.925439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e354e0ebdac4a4bac8c7661bc4c9f74)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:03.927487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:03.934107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630ce3b-4e98-473d-9c1b-24782f96e384 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:03.940137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:03.940853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:03.941196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:03.941608 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] PATH_INFO: `/v3/users/d9df118bb170477aa2ca2811a13efa8e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:03.943122 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9df118bb170477aa2ca2811a13efa8e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:03.946273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:04.483211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e354e0ebdac4a4bac8c7661bc4c9f74'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:04.507812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9df118bb170477aa2ca2811a13efa8e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:04.514689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9df118bb170477aa2ca2811a13efa8e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:04.520205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9df118bb170477aa2ca2811a13efa8e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:04.527608 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9df118bb170477aa2ca2811a13efa8e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:04.553935 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e354e0ebdac4a4bac8c7661bc4c9f74'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:04.561331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e354e0ebdac4a4bac8c7661bc4c9f74'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:04.561973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e354e0ebdac4a4bac8c7661bc4c9f74'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:04.573438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e354e0ebdac4a4bac8c7661bc4c9f74'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:04.579377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 935/1862] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:03 2022] DELETE /identity/v3/users/9e354e0ebdac4a4bac8c7661bc4c9f74 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:04.580154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:04.581551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:04.617406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-2caccd42-a050-44ca-8c6d-3354210e69ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9df118bb170477aa2ca2811a13efa8e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:04.623657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 928/1863] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:03 2022] DELETE /identity/v3/users/d9df118bb170477aa2ca2811a13efa8e => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:04.625200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee52593-e2fc-4139-b8d9-6eaca65027a5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:04.625676 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee52593-e2fc-4139-b8d9-6eaca65027a5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:04.625870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee52593-e2fc-4139-b8d9-6eaca65027a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:04.645195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-fee52593-e2fc-4139-b8d9-6eaca65027a5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:04.646457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365ad62-f565-4a92-8c1a-db81e58f3b5b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:04.646586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fee52593-e2fc-4139-b8d9-6eaca65027a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:04.680494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:04.706068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73b3d4-2955-47a2-964e-7b76e4477faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:04.706689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73b3d4-2955-47a2-964e-7b76e4477faa admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:04.706964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73b3d4-2955-47a2-964e-7b76e4477faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:04.707240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73b3d4-2955-47a2-964e-7b76e4477faa admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:04.707904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73b3d4-2955-47a2-964e-7b76e4477faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:04.714347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 929/1864] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:04.714593 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73b3d4-2955-47a2-964e-7b76e4477faa admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:04.714691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0287fd-5d07-425e-a2e0-684867f07d3b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:04.714691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0287fd-5d07-425e-a2e0-684867f07d3b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:04.714691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0287fd-5d07-425e-a2e0-684867f07d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:04.731956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7c0287fd-5d07-425e-a2e0-684867f07d3b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:04.735556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7c0287fd-5d07-425e-a2e0-684867f07d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:04.740802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 930/1865] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:04.741900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0287fd-5d07-425e-a2e0-684867f07d3b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:04.743152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7c0287fd-5d07-425e-a2e0-684867f07d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:04.799087 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0287fd-5d07-425e-a2e0-684867f07d3b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:04.804102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 936/1866] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:04 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:04.804102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73b3d4-2955-47a2-964e-7b76e4477faa admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:04.866719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ee6f5-4d4a-4ca4-b449-e6ebbedae7d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:04.867548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ee6f5-4d4a-4ca4-b449-e6ebbedae7d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:04.868225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ee6f5-4d4a-4ca4-b449-e6ebbedae7d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:04.868620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ee6f5-4d4a-4ca4-b449-e6ebbedae7d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:04.873644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73b3d4-2955-47a2-964e-7b76e4477faa admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:04.874887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:04.877797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7a3be-6970-4087-bbf9-6e60a8c8c969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:04.878616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a3be-6970-4087-bbf9-6e60a8c8c969 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:04.878991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a3be-6970-4087-bbf9-6e60a8c8c969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:04.879329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a3be-6970-4087-bbf9-6e60a8c8c969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:04.946812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ee6f5-4d4a-4ca4-b449-e6ebbedae7d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:04.947714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7a3be-6970-4087-bbf9-6e60a8c8c969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:04.948332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ee6f5-4d4a-4ca4-b449-e6ebbedae7d2 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:04.950223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7a3be-6970-4087-bbf9-6e60a8c8c969 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:04.960565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 931/1867] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:04.961387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ee6f5-4d4a-4ca4-b449-e6ebbedae7d2 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:04.962895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d57ee6f5-4d4a-4ca4-b449-e6ebbedae7d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:04.965732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 937/1868] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:04.975162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ee6f5-4d4a-4ca4-b449-e6ebbedae7d2 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:04.979955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe321117-879c-4cec-88d9-0ea05418bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:04.980586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe321117-879c-4cec-88d9-0ea05418bc2b admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:04.980862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe321117-879c-4cec-88d9-0ea05418bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:04.981130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe321117-879c-4cec-88d9-0ea05418bc2b admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:04.981749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe321117-879c-4cec-88d9-0ea05418bc2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:04.983667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe321117-879c-4cec-88d9-0ea05418bc2b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:05.056530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 932/1869] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:04 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:05.060835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7a3be-6970-4087-bbf9-6e60a8c8c969 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:05.071542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7a3be-6970-4087-bbf9-6e60a8c8c969 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:05.076314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402968d-b19a-4ed8-b14d-3863324bff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:05.077031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402968d-b19a-4ed8-b14d-3863324bff4a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:05.077305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402968d-b19a-4ed8-b14d-3863324bff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:05.077604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402968d-b19a-4ed8-b14d-3863324bff4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:05.078234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402968d-b19a-4ed8-b14d-3863324bff4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:05.079813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402968d-b19a-4ed8-b14d-3863324bff4a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:05.091135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 938/1870] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:05.095630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe321117-879c-4cec-88d9-0ea05418bc2b admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:05.105911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe321117-879c-4cec-88d9-0ea05418bc2b admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:05.111108 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad1add-041b-4b60-bec1-cbeb1605b3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:05.116743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad1add-041b-4b60-bec1-cbeb1605b3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:05.116743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad1add-041b-4b60-bec1-cbeb1605b3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:05.116743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad1add-041b-4b60-bec1-cbeb1605b3c3 admin admin] PATH_INFO: `/v3/projects/a02a7678dcec432db30e39e73c21de70/users/e683129cd0a0457b85f2edd5faa2969c/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:05.129725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad1add-041b-4b60-bec1-cbeb1605b3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02a7678dcec432db30e39e73c21de70, user_id=e683129cd0a0457b85f2edd5faa2969c, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:05.132762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad1add-041b-4b60-bec1-cbeb1605b3c3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:05.200320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 933/1871] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:05 2022] PUT /identity/v3/projects/a02a7678dcec432db30e39e73c21de70/users/e683129cd0a0457b85f2edd5faa2969c/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:05.204457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402968d-b19a-4ed8-b14d-3863324bff4a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:05.215326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402968d-b19a-4ed8-b14d-3863324bff4a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:05.271596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046e160-527f-452d-b954-2572da79a337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:05.272866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046e160-527f-452d-b954-2572da79a337 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:05.273168 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046e160-527f-452d-b954-2572da79a337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:05.273499 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046e160-527f-452d-b954-2572da79a337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:05.274141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046e160-527f-452d-b954-2572da79a337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:05.275732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046e160-527f-452d-b954-2572da79a337 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:05.288674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 939/1872] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:05.292782 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad1add-041b-4b60-bec1-cbeb1605b3c3 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:05.304482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad1add-041b-4b60-bec1-cbeb1605b3c3 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:05.313298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d692a-27d7-481f-8c13-3619b042d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:05.313980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d692a-27d7-481f-8c13-3619b042d56f admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:05.314253 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d692a-27d7-481f-8c13-3619b042d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:05.314524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d692a-27d7-481f-8c13-3619b042d56f admin admin] PATH_INFO: `/v3/projects/a02a7678dcec432db30e39e73c21de70/users/e683129cd0a0457b85f2edd5faa2969c/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:05.317094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d692a-27d7-481f-8c13-3619b042d56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02a7678dcec432db30e39e73c21de70, user_id=e683129cd0a0457b85f2edd5faa2969c, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:05.320817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d692a-27d7-481f-8c13-3619b042d56f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:05.337191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 934/1873] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:05 2022] PUT /identity/v3/projects/a02a7678dcec432db30e39e73c21de70/users/e683129cd0a0457b85f2edd5faa2969c/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:05.347045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e08ad-e7d2-4200-a607-9acab70d86dc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:05.347359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e08ad-e7d2-4200-a607-9acab70d86dc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:05.347598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e08ad-e7d2-4200-a607-9acab70d86dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:05.391799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e80e08ad-e7d2-4200-a607-9acab70d86dc None None] MFA Rules not processed for user `e683129cd0a0457b85f2edd5faa2969c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:05.393347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e80e08ad-e7d2-4200-a607-9acab70d86dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:05.478202 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 940/1874] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:05.491964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d692a-27d7-481f-8c13-3619b042d56f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:05.499306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-158d692a-27d7-481f-8c13-3619b042d56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:05.570080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d692a-27d7-481f-8c13-3619b042d56f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:05.573940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fea1dd-6d1a-4cbe-a3d5-e0ae1340b07d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:05.574566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fea1dd-6d1a-4cbe-a3d5-e0ae1340b07d service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:05.574846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fea1dd-6d1a-4cbe-a3d5-e0ae1340b07d service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:05.575147 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fea1dd-6d1a-4cbe-a3d5-e0ae1340b07d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:05.576948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d8fea1dd-6d1a-4cbe-a3d5-e0ae1340b07d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:05.636620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fea1dd-6d1a-4cbe-a3d5-e0ae1340b07d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:05.638096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fea1dd-6d1a-4cbe-a3d5-e0ae1340b07d service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:05.648092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 935/1875] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:05.662356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e08ad-e7d2-4200-a607-9acab70d86dc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:05.664058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e80e08ad-e7d2-4200-a607-9acab70d86dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:05.672385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fea1dd-6d1a-4cbe-a3d5-e0ae1340b07d service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:05.673729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d8fea1dd-6d1a-4cbe-a3d5-e0ae1340b07d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:05.768476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e08ad-e7d2-4200-a607-9acab70d86dc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:05.774142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:05.775470 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:05.775758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:05.776347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] PATH_INFO: `/v3/projects/2fe180b0ff514e2788ba2ab6ee6600d4` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:05.777717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe180b0ff514e2788ba2ab6ee6600d4)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:05.779639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:05.780831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fea1dd-6d1a-4cbe-a3d5-e0ae1340b07d service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:05.789747 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:05.791090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:05.791445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:05.791820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] PATH_INFO: `/v3/projects/625eed16498046e5af22b590597c54e0` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:05.793506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625eed16498046e5af22b590597c54e0)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:05.796377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:05.919300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe180b0ff514e2788ba2ab6ee6600d4', 'request_id': 'req-e55697cf-2348-4712-b874-97d648315d9d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:05.920408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625eed16498046e5af22b590597c54e0', 'request_id': 'req-c37a7746-8e52-4167-9ddf-475b486f8657'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:05.924625 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe180b0ff514e2788ba2ab6ee6600d4', 'request_id': 'req-e55697cf-2348-4712-b874-97d648315d9d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:05.925891 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625eed16498046e5af22b590597c54e0', 'request_id': 'req-c37a7746-8e52-4167-9ddf-475b486f8657'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:05.930796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe180b0ff514e2788ba2ab6ee6600d4', 'request_id': 'req-e55697cf-2348-4712-b874-97d648315d9d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:05.932623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625eed16498046e5af22b590597c54e0', 'request_id': 'req-c37a7746-8e52-4167-9ddf-475b486f8657'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.019679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] The token cache is being invalidate because project 2fe180b0ff514e2788ba2ab6ee6600d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:06.020117 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.020840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.023018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 941/1876] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:05 2022] DELETE /identity/v3/projects/2fe180b0ff514e2788ba2ab6ee6600d4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:06.028865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:06.030452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:06.100316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55697cf-2348-4712-b874-97d648315d9d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:06.111689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] The token cache is being invalidate because project 625eed16498046e5af22b590597c54e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:06.112257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.115210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.119658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 936/1877] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:05 2022] DELETE /identity/v3/projects/625eed16498046e5af22b590597c54e0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:06.123926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:06.139526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:06.179251 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:06.180444 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:06.180726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:06.181491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] PATH_INFO: `/v3/users/e7fa03a06efa40e78f20b62fa6368d57` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:06.182902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7fa03a06efa40e78f20b62fa6368d57)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:06.185775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:06.244651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a7746-8e52-4167-9ddf-475b486f8657 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:06.250594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:06.252038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:06.252038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:06.252038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] PATH_INFO: `/v3/users/ba699ec9ad484db7bda04b6597c84822` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:06.257675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba699ec9ad484db7bda04b6597c84822)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:06.262363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:06.458647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7fa03a06efa40e78f20b62fa6368d57'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.491199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba699ec9ad484db7bda04b6597c84822'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.492367 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba699ec9ad484db7bda04b6597c84822'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.516192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba699ec9ad484db7bda04b6597c84822'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.516192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba699ec9ad484db7bda04b6597c84822'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.535656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7fa03a06efa40e78f20b62fa6368d57'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.543404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7fa03a06efa40e78f20b62fa6368d57'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.544624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7fa03a06efa40e78f20b62fa6368d57'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.555716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7fa03a06efa40e78f20b62fa6368d57'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.561627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 942/1878] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:06 2022] DELETE /identity/v3/users/e7fa03a06efa40e78f20b62fa6368d57 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:06.633796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba699ec9ad484db7bda04b6597c84822'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:06.640746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 937/1879] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:06 2022] DELETE /identity/v3/users/ba699ec9ad484db7bda04b6597c84822 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:06.874420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:06.947444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:07.109550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:07.111180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:07.145080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:07.147162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:07.210349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78688-dd29-43da-a4a5-9744d72bf1de admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:07.226040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a554a4b-30e1-406d-bf3d-1e211a0de931 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:07.231111 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:07.231740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.232076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.232430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] PATH_INFO: `/v3/projects/86346965d8964f999a71e5fbf527ca60` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.233769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86346965d8964f999a71e5fbf527ca60)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:07.235671 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:07.271584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:07.271584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.271584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.271584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] PATH_INFO: `/v3/projects/aa338d60bdf548db87b84fa271aa0cdd` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.272174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa338d60bdf548db87b84fa271aa0cdd)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:07.272507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:07.338590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86346965d8964f999a71e5fbf527ca60', 'request_id': 'req-3964f649-d6de-488e-824e-b89ecfb4edd2'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:07.352202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86346965d8964f999a71e5fbf527ca60', 'request_id': 'req-3964f649-d6de-488e-824e-b89ecfb4edd2'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:07.360791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86346965d8964f999a71e5fbf527ca60', 'request_id': 'req-3964f649-d6de-488e-824e-b89ecfb4edd2'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:07.416348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa338d60bdf548db87b84fa271aa0cdd', 'request_id': 'req-d75453a4-350c-4f53-9da4-1985e1e2c494'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:07.424008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa338d60bdf548db87b84fa271aa0cdd', 'request_id': 'req-d75453a4-350c-4f53-9da4-1985e1e2c494'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:07.432002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa338d60bdf548db87b84fa271aa0cdd', 'request_id': 'req-d75453a4-350c-4f53-9da4-1985e1e2c494'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:07.463100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] The token cache is being invalidate because project 86346965d8964f999a71e5fbf527ca60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:07.467394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:07.467394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3964f649-d6de-488e-824e-b89ecfb4edd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:07.467394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 938/1880] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:07 2022] DELETE /identity/v3/projects/86346965d8964f999a71e5fbf527ca60 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:07.471725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a24d3-6140-4394-872a-4504b2af0585 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.472051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a24d3-6140-4394-872a-4504b2af0585 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.472332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a24d3-6140-4394-872a-4504b2af0585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.494700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-540a24d3-6140-4394-872a-4504b2af0585 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:07.496083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-540a24d3-6140-4394-872a-4504b2af0585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:07.572527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 939/1881] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:07.595673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c941-a6cb-4813-b093-ea6bde64d8f1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.595673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c941-a6cb-4813-b093-ea6bde64d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.595673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c941-a6cb-4813-b093-ea6bde64d8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.597465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] The token cache is being invalidate because project aa338d60bdf548db87b84fa271aa0cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:07.597756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:07.598526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d75453a4-350c-4f53-9da4-1985e1e2c494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:07.601120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 943/1882] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:07 2022] DELETE /identity/v3/projects/aa338d60bdf548db87b84fa271aa0cdd => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:07.606291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e946d78-3dcf-4fe6-8859-70698e88ff78 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.611245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e946d78-3dcf-4fe6-8859-70698e88ff78 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.611245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e946d78-3dcf-4fe6-8859-70698e88ff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.611570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-60f9c941-a6cb-4813-b093-ea6bde64d8f1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:07.611570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-60f9c941-a6cb-4813-b093-ea6bde64d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:07.618989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 940/1883] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:07.623802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9c941-a6cb-4813-b093-ea6bde64d8f1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:07.640479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6e946d78-3dcf-4fe6-8859-70698e88ff78 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:07.640587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9c941-a6cb-4813-b093-ea6bde64d8f1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:07.641006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6e946d78-3dcf-4fe6-8859-70698e88ff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:07.641095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea87a8c-2107-43a2-a5b2-64142cfb7498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:07.641095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea87a8c-2107-43a2-a5b2-64142cfb7498 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.641095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea87a8c-2107-43a2-a5b2-64142cfb7498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.641095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea87a8c-2107-43a2-a5b2-64142cfb7498 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.641403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea87a8c-2107-43a2-a5b2-64142cfb7498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:07.641403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea87a8c-2107-43a2-a5b2-64142cfb7498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:07.641892 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea87a8c-2107-43a2-a5b2-64142cfb7498 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:07.644055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 944/1884] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:07.652519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4d63-93af-4b0c-a797-9a4955f05865 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.652804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4d63-93af-4b0c-a797-9a4955f05865 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.653084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4d63-93af-4b0c-a797-9a4955f05865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.659491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 941/1885] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:07.660677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea87a8c-2107-43a2-a5b2-64142cfb7498 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:07.673585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea87a8c-2107-43a2-a5b2-64142cfb7498 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:07.673691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-285b4d63-93af-4b0c-a797-9a4955f05865 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:07.674604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-285b4d63-93af-4b0c-a797-9a4955f05865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:07.680865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff00c-75f4-4e8b-b413-a40475b9793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:07.681516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff00c-75f4-4e8b-b413-a40475b9793d admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.681791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff00c-75f4-4e8b-b413-a40475b9793d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.682061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff00c-75f4-4e8b-b413-a40475b9793d admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.682695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aff00c-75f4-4e8b-b413-a40475b9793d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:07.685066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aff00c-75f4-4e8b-b413-a40475b9793d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:07.689257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 945/1886] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:07.690288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b4d63-93af-4b0c-a797-9a4955f05865 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:07.699524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b4d63-93af-4b0c-a797-9a4955f05865 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:07.704758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527c00e-58e5-4256-922b-2fb71f7ff689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:07.705357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527c00e-58e5-4256-922b-2fb71f7ff689 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.705636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527c00e-58e5-4256-922b-2fb71f7ff689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.705908 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527c00e-58e5-4256-922b-2fb71f7ff689 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.706717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527c00e-58e5-4256-922b-2fb71f7ff689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:07.707020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527c00e-58e5-4256-922b-2fb71f7ff689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:07.708648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527c00e-58e5-4256-922b-2fb71f7ff689 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:07.721222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 946/1887] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:07.725749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527c00e-58e5-4256-922b-2fb71f7ff689 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:07.735760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527c00e-58e5-4256-922b-2fb71f7ff689 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:07.742502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68c532-de46-44dd-b789-dc6f617615ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:07.743876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c532-de46-44dd-b789-dc6f617615ff admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.743876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c532-de46-44dd-b789-dc6f617615ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.743876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c532-de46-44dd-b789-dc6f617615ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.744582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68c532-de46-44dd-b789-dc6f617615ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:07.746641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68c532-de46-44dd-b789-dc6f617615ff admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:07.837959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 942/1888] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:07 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:07.839673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff00c-75f4-4e8b-b413-a40475b9793d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:07.863437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 947/1889] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:07 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:07.867986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68c532-de46-44dd-b789-dc6f617615ff admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:07.909357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff00c-75f4-4e8b-b413-a40475b9793d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:07.952829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68c532-de46-44dd-b789-dc6f617615ff admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:07.958599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02ba3-3d8d-44c9-9408-b506757967d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:07.960177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02ba3-3d8d-44c9-9408-b506757967d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.960725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02ba3-3d8d-44c9-9408-b506757967d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.961212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02ba3-3d8d-44c9-9408-b506757967d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.962075 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c02ba3-3d8d-44c9-9408-b506757967d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:07.966086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c02ba3-3d8d-44c9-9408-b506757967d7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:07.991805 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae24f51-a8e3-4017-b5be-4d3b6811f312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:07.992858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae24f51-a8e3-4017-b5be-4d3b6811f312 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:07.993131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae24f51-a8e3-4017-b5be-4d3b6811f312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:07.993408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae24f51-a8e3-4017-b5be-4d3b6811f312 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:07.994046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae24f51-a8e3-4017-b5be-4d3b6811f312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:07.996127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae24f51-a8e3-4017-b5be-4d3b6811f312 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.059424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 948/1890] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:07 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:08.062391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02ba3-3d8d-44c9-9408-b506757967d7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.076646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02ba3-3d8d-44c9-9408-b506757967d7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.081561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f2cb-787f-4675-9f08-e33354caea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.082172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f2cb-787f-4675-9f08-e33354caea38 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.082497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f2cb-787f-4675-9f08-e33354caea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.082769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f2cb-787f-4675-9f08-e33354caea38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.083556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05f2cb-787f-4675-9f08-e33354caea38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.085958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05f2cb-787f-4675-9f08-e33354caea38 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.096777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 949/1891] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:08.100696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f2cb-787f-4675-9f08-e33354caea38 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.117088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f2cb-787f-4675-9f08-e33354caea38 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.117646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 943/1892] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:07 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:08.117754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9b0ce-24ad-4433-b0a9-9805187b8bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.117754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b0ce-24ad-4433-b0a9-9805187b8bea admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.117754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b0ce-24ad-4433-b0a9-9805187b8bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.118000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b0ce-24ad-4433-b0a9-9805187b8bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.118625 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9b0ce-24ad-4433-b0a9-9805187b8bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.119809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae24f51-a8e3-4017-b5be-4d3b6811f312 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.120385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9b0ce-24ad-4433-b0a9-9805187b8bea admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.130081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae24f51-a8e3-4017-b5be-4d3b6811f312 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.131573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 950/1893] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:08.135695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfd3ff-1db9-4a30-a2c6-ef3b88366cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.135851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9b0ce-24ad-4433-b0a9-9805187b8bea admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.136161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfd3ff-1db9-4a30-a2c6-ef3b88366cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.136435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfd3ff-1db9-4a30-a2c6-ef3b88366cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.136704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfd3ff-1db9-4a30-a2c6-ef3b88366cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.137345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfd3ff-1db9-4a30-a2c6-ef3b88366cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.138928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfd3ff-1db9-4a30-a2c6-ef3b88366cb7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.146647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9b0ce-24ad-4433-b0a9-9805187b8bea admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.152264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91de09-7150-4395-afc9-9c117226185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.153264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91de09-7150-4395-afc9-9c117226185a admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.153603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91de09-7150-4395-afc9-9c117226185a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.154588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91de09-7150-4395-afc9-9c117226185a admin admin] PATH_INFO: `/v3/projects/dcba67b46d754ff2aadc47f6be96357b/users/3f1099557a1b48f5b47108406742a0f1/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.169362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 944/1894] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:08.170357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91de09-7150-4395-afc9-9c117226185a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcba67b46d754ff2aadc47f6be96357b, user_id=3f1099557a1b48f5b47108406742a0f1, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.179765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91de09-7150-4395-afc9-9c117226185a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.182922 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfd3ff-1db9-4a30-a2c6-ef3b88366cb7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.193491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfd3ff-1db9-4a30-a2c6-ef3b88366cb7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.198742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cef4f-dc05-49a1-992e-594044f9e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.199328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cef4f-dc05-49a1-992e-594044f9e75f admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.199602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cef4f-dc05-49a1-992e-594044f9e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.199873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cef4f-dc05-49a1-992e-594044f9e75f admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.200521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cef4f-dc05-49a1-992e-594044f9e75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.202101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cef4f-dc05-49a1-992e-594044f9e75f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.213114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 945/1895] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:08.217139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cef4f-dc05-49a1-992e-594044f9e75f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.226613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cef4f-dc05-49a1-992e-594044f9e75f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.231131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb51c6e-3ae3-4d3c-83f0-b3268bf4cb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.231743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51c6e-3ae3-4d3c-83f0-b3268bf4cb0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.232059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51c6e-3ae3-4d3c-83f0-b3268bf4cb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.232327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51c6e-3ae3-4d3c-83f0-b3268bf4cb0d admin admin] PATH_INFO: `/v3/projects/bf00752f895847998c33c465cb28e196/users/f4748067918b4dc8bd2fe00e86fa2731/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.246234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb51c6e-3ae3-4d3c-83f0-b3268bf4cb0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf00752f895847998c33c465cb28e196, user_id=f4748067918b4dc8bd2fe00e86fa2731, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.248943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb51c6e-3ae3-4d3c-83f0-b3268bf4cb0d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.264666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 951/1896] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:08 2022] PUT /identity/v3/projects/dcba67b46d754ff2aadc47f6be96357b/users/3f1099557a1b48f5b47108406742a0f1/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:08.277032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6560-333e-4976-a900-c926e4c2e651 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.277338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6560-333e-4976-a900-c926e4c2e651 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.277650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6560-333e-4976-a900-c926e4c2e651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.305050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-135d6560-333e-4976-a900-c926e4c2e651 None None] MFA Rules not processed for user `3f1099557a1b48f5b47108406742a0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:08.306291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-135d6560-333e-4976-a900-c926e4c2e651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:08.323208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 946/1897] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:08 2022] PUT /identity/v3/projects/bf00752f895847998c33c465cb28e196/users/f4748067918b4dc8bd2fe00e86fa2731/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:08.330663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44361a7-e687-4f3e-be75-cb7aa54a2e9d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.330947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44361a7-e687-4f3e-be75-cb7aa54a2e9d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.331222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44361a7-e687-4f3e-be75-cb7aa54a2e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.361945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f44361a7-e687-4f3e-be75-cb7aa54a2e9d None None] MFA Rules not processed for user `f4748067918b4dc8bd2fe00e86fa2731`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:08.363158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f44361a7-e687-4f3e-be75-cb7aa54a2e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:08.383121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 952/1898] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:08.387190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d6560-333e-4976-a900-c926e4c2e651 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.442843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 947/1899] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:08.448003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44361a7-e687-4f3e-be75-cb7aa54a2e9d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.457109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d6560-333e-4976-a900-c926e4c2e651 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.523920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44361a7-e687-4f3e-be75-cb7aa54a2e9d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.530040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a7b13-c567-4fdf-a561-db5adafcf161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.531767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661befe-e251-40da-8c4f-68af6a20abaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.532316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661befe-e251-40da-8c4f-68af6a20abaa admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.532640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661befe-e251-40da-8c4f-68af6a20abaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.532920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661befe-e251-40da-8c4f-68af6a20abaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.533311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a7b13-c567-4fdf-a561-db5adafcf161 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.533596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a7b13-c567-4fdf-a561-db5adafcf161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.533754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661befe-e251-40da-8c4f-68af6a20abaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.533930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a7b13-c567-4fdf-a561-db5adafcf161 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.534610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a7b13-c567-4fdf-a561-db5adafcf161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.536067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661befe-e251-40da-8c4f-68af6a20abaa admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.536614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a7b13-c567-4fdf-a561-db5adafcf161 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.667278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 948/1900] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:08 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:08.669993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 953/1901] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:08 2022] POST /identity/v3/projects => generated 387 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:08.671554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661befe-e251-40da-8c4f-68af6a20abaa admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.674099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a7b13-c567-4fdf-a561-db5adafcf161 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.768352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a7b13-c567-4fdf-a561-db5adafcf161 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.808921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661befe-e251-40da-8c4f-68af6a20abaa admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.814252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae9025-3a30-497f-bfb6-ab45ebdb8b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.815071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae9025-3a30-497f-bfb6-ab45ebdb8b68 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.815451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae9025-3a30-497f-bfb6-ab45ebdb8b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.815791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae9025-3a30-497f-bfb6-ab45ebdb8b68 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.816668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae9025-3a30-497f-bfb6-ab45ebdb8b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.818836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae9025-3a30-497f-bfb6-ab45ebdb8b68 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.866310 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09537b3c-afd9-4a08-8c85-7fb824202e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.867219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09537b3c-afd9-4a08-8c85-7fb824202e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.868189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09537b3c-afd9-4a08-8c85-7fb824202e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.868537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09537b3c-afd9-4a08-8c85-7fb824202e89 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.869819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09537b3c-afd9-4a08-8c85-7fb824202e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.871867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09537b3c-afd9-4a08-8c85-7fb824202e89 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.907317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 954/1902] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:08 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:08.908528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae9025-3a30-497f-bfb6-ab45ebdb8b68 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.919703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae9025-3a30-497f-bfb6-ab45ebdb8b68 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.924957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5cc2f-ec20-4e8b-a24b-f85c886d97da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.925586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5cc2f-ec20-4e8b-a24b-f85c886d97da admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.925867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5cc2f-ec20-4e8b-a24b-f85c886d97da admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.926141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5cc2f-ec20-4e8b-a24b-f85c886d97da admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.926790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5cc2f-ec20-4e8b-a24b-f85c886d97da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.929495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5cc2f-ec20-4e8b-a24b-f85c886d97da admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.932813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:08.945612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 955/1903] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:08.946872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5cc2f-ec20-4e8b-a24b-f85c886d97da admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:08.957471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5cc2f-ec20-4e8b-a24b-f85c886d97da admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:08.962888 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2beb-1408-412c-9ddd-b89d9ebb9aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:08.963569 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2beb-1408-412c-9ddd-b89d9ebb9aec admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:08.964199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2beb-1408-412c-9ddd-b89d9ebb9aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:08.968361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2beb-1408-412c-9ddd-b89d9ebb9aec admin admin] PATH_INFO: `/v3/projects/a6ae4502e3dc40f389fe8404d64bfb0d/users/03317c57fa0144a58c8b2f867b16babb/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:08.981022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f2beb-1408-412c-9ddd-b89d9ebb9aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ae4502e3dc40f389fe8404d64bfb0d, user_id=03317c57fa0144a58c8b2f867b16babb, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:08.983945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f2beb-1408-412c-9ddd-b89d9ebb9aec admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:08.995321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 949/1904] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:08 2022] POST /identity/v3/users => generated 294 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:08.999210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09537b3c-afd9-4a08-8c85-7fb824202e89 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:09.009417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09537b3c-afd9-4a08-8c85-7fb824202e89 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:09.014016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a9e50-2469-41a4-a1e3-afef84bb6a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:09.014615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a9e50-2469-41a4-a1e3-afef84bb6a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:09.014895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a9e50-2469-41a4-a1e3-afef84bb6a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:09.015233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a9e50-2469-41a4-a1e3-afef84bb6a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:09.015802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a9e50-2469-41a4-a1e3-afef84bb6a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:09.017445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a9e50-2469-41a4-a1e3-afef84bb6a5e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:09.028080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 950/1905] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:09.032039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a9e50-2469-41a4-a1e3-afef84bb6a5e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:09.042339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a9e50-2469-41a4-a1e3-afef84bb6a5e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:09.047109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02e3e2-73e3-4daa-8123-7ac506641e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:09.047699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02e3e2-73e3-4daa-8123-7ac506641e08 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:09.048004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02e3e2-73e3-4daa-8123-7ac506641e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:09.048280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02e3e2-73e3-4daa-8123-7ac506641e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:09.048917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02e3e2-73e3-4daa-8123-7ac506641e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:09.050481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02e3e2-73e3-4daa-8123-7ac506641e08 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:09.062325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 951/1906] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:09.066409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02e3e2-73e3-4daa-8123-7ac506641e08 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:09.074831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:09.081521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02e3e2-73e3-4daa-8123-7ac506641e08 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:09.084738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2876c1-bd56-4fdd-9536-0fe32ccd0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:09.085715 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2876c1-bd56-4fdd-9536-0fe32ccd0882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:09.085992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2876c1-bd56-4fdd-9536-0fe32ccd0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:09.086260 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2876c1-bd56-4fdd-9536-0fe32ccd0882 admin admin] PATH_INFO: `/v3/projects/ce3c8f98c5774814803c6bd871940c15/users/d0949e22a0644bf0b1e27accd3ceebbc/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:09.106554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2876c1-bd56-4fdd-9536-0fe32ccd0882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3c8f98c5774814803c6bd871940c15, user_id=d0949e22a0644bf0b1e27accd3ceebbc, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:09.109559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 956/1907] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:08 2022] PUT /identity/v3/projects/a6ae4502e3dc40f389fe8404d64bfb0d/users/03317c57fa0144a58c8b2f867b16babb/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:09.113474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2beb-1408-412c-9ddd-b89d9ebb9aec admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:09.115143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2876c1-bd56-4fdd-9536-0fe32ccd0882 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:09.183853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2beb-1408-412c-9ddd-b89d9ebb9aec admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:09.189213 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f548ece-0949-43a3-9e69-d04fbd8c2600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:09.189956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f548ece-0949-43a3-9e69-d04fbd8c2600 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:09.190309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f548ece-0949-43a3-9e69-d04fbd8c2600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:09.190662 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f548ece-0949-43a3-9e69-d04fbd8c2600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:09.191395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f548ece-0949-43a3-9e69-d04fbd8c2600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:09.193564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f548ece-0949-43a3-9e69-d04fbd8c2600 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:09.206361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 957/1908] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:09.211517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f548ece-0949-43a3-9e69-d04fbd8c2600 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:09.224122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f548ece-0949-43a3-9e69-d04fbd8c2600 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:09.232884 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 952/1909] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:09 2022] PUT /identity/v3/projects/ce3c8f98c5774814803c6bd871940c15/users/d0949e22a0644bf0b1e27accd3ceebbc/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:09.244283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0bca5-92e4-4f83-a0d2-8cb62beeb8a4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:09.244719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0bca5-92e4-4f83-a0d2-8cb62beeb8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:09.245092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0bca5-92e4-4f83-a0d2-8cb62beeb8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:09.280008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6bb0bca5-92e4-4f83-a0d2-8cb62beeb8a4 None None] MFA Rules not processed for user `d0949e22a0644bf0b1e27accd3ceebbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:09.281659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6bb0bca5-92e4-4f83-a0d2-8cb62beeb8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:09.320221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8065765-5ff3-467c-8c6e-39bade9c8a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:09.320982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8065765-5ff3-467c-8c6e-39bade9c8a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:09.321333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8065765-5ff3-467c-8c6e-39bade9c8a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:09.321663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8065765-5ff3-467c-8c6e-39bade9c8a3a admin admin] PATH_INFO: `/v3/projects/a6ae4502e3dc40f389fe8404d64bfb0d/users/03317c57fa0144a58c8b2f867b16babb/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:09.324265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8065765-5ff3-467c-8c6e-39bade9c8a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ae4502e3dc40f389fe8404d64bfb0d, user_id=03317c57fa0144a58c8b2f867b16babb, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:09.327901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8065765-5ff3-467c-8c6e-39bade9c8a3a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:09.342179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 958/1910] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:09 2022] PUT /identity/v3/projects/a6ae4502e3dc40f389fe8404d64bfb0d/users/03317c57fa0144a58c8b2f867b16babb/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:09.353295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29b16-b6db-4f9d-a51b-46e20c315801 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:09.353478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29b16-b6db-4f9d-a51b-46e20c315801 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:09.353759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29b16-b6db-4f9d-a51b-46e20c315801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:09.386237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-aec29b16-b6db-4f9d-a51b-46e20c315801 None None] MFA Rules not processed for user `03317c57fa0144a58c8b2f867b16babb`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:09.387486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-aec29b16-b6db-4f9d-a51b-46e20c315801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:09.389482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 953/1911] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:09.394711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0bca5-92e4-4f83-a0d2-8cb62beeb8a4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:09.407087 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0bca5-92e4-4f83-a0d2-8cb62beeb8a4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:09.485317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ea78c-8706-4442-bb67-aae1a2ea88cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:09.486066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ea78c-8706-4442-bb67-aae1a2ea88cb admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:09.486882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ea78c-8706-4442-bb67-aae1a2ea88cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:09.486882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ea78c-8706-4442-bb67-aae1a2ea88cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:09.487420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ea78c-8706-4442-bb67-aae1a2ea88cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:09.490258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ea78c-8706-4442-bb67-aae1a2ea88cb admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:09.503204 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 959/1912] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:09.512489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29b16-b6db-4f9d-a51b-46e20c315801 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:09.514103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-aec29b16-b6db-4f9d-a51b-46e20c315801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:09.577763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29b16-b6db-4f9d-a51b-46e20c315801 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:09.620261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b7c3e-2495-497d-a06a-2ef6ee36b744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:09.620261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b7c3e-2495-497d-a06a-2ef6ee36b744 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:09.620261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b7c3e-2495-497d-a06a-2ef6ee36b744 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:09.620261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b7c3e-2495-497d-a06a-2ef6ee36b744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:09.648346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b7c3e-2495-497d-a06a-2ef6ee36b744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:09.650248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b7c3e-2495-497d-a06a-2ef6ee36b744 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:09.662239 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 960/1913] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:10.250559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 954/1914] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:09 2022] POST /identity/v3/projects => generated 387 bytes in 854 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:10.251778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b7c3e-2495-497d-a06a-2ef6ee36b744 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:10.264641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b7c3e-2495-497d-a06a-2ef6ee36b744 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:10.374199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67679340-5913-49cd-b288-ce229881c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:10.374836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67679340-5913-49cd-b288-ce229881c2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:10.375339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67679340-5913-49cd-b288-ce229881c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:10.375622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67679340-5913-49cd-b288-ce229881c2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:10.376460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67679340-5913-49cd-b288-ce229881c2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:10.378668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67679340-5913-49cd-b288-ce229881c2f2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:10.476295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 961/1915] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:10 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:10.480711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ea78c-8706-4442-bb67-aae1a2ea88cb admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:10.494475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ea78c-8706-4442-bb67-aae1a2ea88cb admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:10.502350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7e98d-bf85-42bd-b528-fe6f49d6011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:10.502989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e98d-bf85-42bd-b528-fe6f49d6011d admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:10.513233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e98d-bf85-42bd-b528-fe6f49d6011d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:10.513233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e98d-bf85-42bd-b528-fe6f49d6011d admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:10.513233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7e98d-bf85-42bd-b528-fe6f49d6011d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:10.513233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7e98d-bf85-42bd-b528-fe6f49d6011d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:10.518905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 955/1916] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:10.524033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67679340-5913-49cd-b288-ce229881c2f2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:10.535019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67679340-5913-49cd-b288-ce229881c2f2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:10.540724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5cc44-9e5d-4b10-8a28-5e59a20a0dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:10.541413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5cc44-9e5d-4b10-8a28-5e59a20a0dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:10.541689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5cc44-9e5d-4b10-8a28-5e59a20a0dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:10.541960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5cc44-9e5d-4b10-8a28-5e59a20a0dd8 admin admin] PATH_INFO: `/v3/projects/96b4ae92c36942cb93397f01a6ba7bf9/users/f6b6a028d72448bba3ca56f1eb81cd17/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:10.557719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5cc44-9e5d-4b10-8a28-5e59a20a0dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b4ae92c36942cb93397f01a6ba7bf9, user_id=f6b6a028d72448bba3ca56f1eb81cd17, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:10.560787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5cc44-9e5d-4b10-8a28-5e59a20a0dd8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:10.663603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 962/1917] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:10 2022] PUT /identity/v3/projects/96b4ae92c36942cb93397f01a6ba7bf9/users/f6b6a028d72448bba3ca56f1eb81cd17/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:10.667349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7e98d-bf85-42bd-b528-fe6f49d6011d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:10.677791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7e98d-bf85-42bd-b528-fe6f49d6011d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:10.737933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918f31d-90a9-4fcf-b7e0-bb2d8087b542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:10.740423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f31d-90a9-4fcf-b7e0-bb2d8087b542 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:10.740423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f31d-90a9-4fcf-b7e0-bb2d8087b542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:10.740423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f31d-90a9-4fcf-b7e0-bb2d8087b542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:10.740423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918f31d-90a9-4fcf-b7e0-bb2d8087b542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:10.741716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918f31d-90a9-4fcf-b7e0-bb2d8087b542 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:10.751813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 956/1918] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:10.755877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5cc44-9e5d-4b10-8a28-5e59a20a0dd8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:10.767379 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5cc44-9e5d-4b10-8a28-5e59a20a0dd8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:10.775328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8338923-3e86-4c84-8868-a007eb63d3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:10.776108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8338923-3e86-4c84-8868-a007eb63d3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:10.776461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8338923-3e86-4c84-8868-a007eb63d3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:10.776821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8338923-3e86-4c84-8868-a007eb63d3ff admin admin] PATH_INFO: `/v3/projects/96b4ae92c36942cb93397f01a6ba7bf9/users/f6b6a028d72448bba3ca56f1eb81cd17/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:10.778864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8338923-3e86-4c84-8868-a007eb63d3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b4ae92c36942cb93397f01a6ba7bf9, user_id=f6b6a028d72448bba3ca56f1eb81cd17, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:10.782522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8338923-3e86-4c84-8868-a007eb63d3ff admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:10.789993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:10.796674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 963/1919] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:10 2022] PUT /identity/v3/projects/96b4ae92c36942cb93397f01a6ba7bf9/users/f6b6a028d72448bba3ca56f1eb81cd17/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:10.811250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0cf7f-9927-4d46-a1c2-93eb566462d4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:10.811250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0cf7f-9927-4d46-a1c2-93eb566462d4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:10.811250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0cf7f-9927-4d46-a1c2-93eb566462d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:10.865971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-96e0cf7f-9927-4d46-a1c2-93eb566462d4 None None] MFA Rules not processed for user `f6b6a028d72448bba3ca56f1eb81cd17`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:10.867614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-96e0cf7f-9927-4d46-a1c2-93eb566462d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:10.886693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:10.960990 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 957/1920] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:11.151553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8338923-3e86-4c84-8868-a007eb63d3ff admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:11.153405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e8338923-3e86-4c84-8868-a007eb63d3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:11.223818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8338923-3e86-4c84-8868-a007eb63d3ff admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:11.227531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcafc6-5227-44c9-ba8f-96b3bf724e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:11.228182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcafc6-5227-44c9-ba8f-96b3bf724e61 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:11.228457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcafc6-5227-44c9-ba8f-96b3bf724e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:11.228739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcafc6-5227-44c9-ba8f-96b3bf724e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:11.238981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcafc6-5227-44c9-ba8f-96b3bf724e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:11.245878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcafc6-5227-44c9-ba8f-96b3bf724e61 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:11.250985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 964/1921] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:11.567914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:12.220368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0cf7f-9927-4d46-a1c2-93eb566462d4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:12.231241 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0cf7f-9927-4d46-a1c2-93eb566462d4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:12.235397 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfc85c-5549-4b2e-8305-444d712b22bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:12.236346 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc85c-5549-4b2e-8305-444d712b22bd service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:12.236778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc85c-5549-4b2e-8305-444d712b22bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:12.237229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc85c-5549-4b2e-8305-444d712b22bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:12.306861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfc85c-5549-4b2e-8305-444d712b22bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:12.308356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfc85c-5549-4b2e-8305-444d712b22bd service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:12.318152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 958/1922] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:12.325968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:12.571007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:12.661874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcafc6-5227-44c9-ba8f-96b3bf724e61 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:12.679632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcafc6-5227-44c9-ba8f-96b3bf724e61 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:12.683494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335050c9-1b9b-4175-8540-83afe7cca8e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:12.684137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335050c9-1b9b-4175-8540-83afe7cca8e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:12.684414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335050c9-1b9b-4175-8540-83afe7cca8e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:12.684682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335050c9-1b9b-4175-8540-83afe7cca8e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:12.744579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfc85c-5549-4b2e-8305-444d712b22bd service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:12.751527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335050c9-1b9b-4175-8540-83afe7cca8e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:12.753112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335050c9-1b9b-4175-8540-83afe7cca8e7 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:12.753277 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfc85c-5549-4b2e-8305-444d712b22bd service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:12.763468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e047a7a-cfe3-45af-a3fe-d80b21df0bd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:12.764077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 965/1923] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:12.764257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e047a7a-cfe3-45af-a3fe-d80b21df0bd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:12.764369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e047a7a-cfe3-45af-a3fe-d80b21df0bd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:12.764668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e047a7a-cfe3-45af-a3fe-d80b21df0bd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:12.766633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4e047a7a-cfe3-45af-a3fe-d80b21df0bd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:12.845664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e047a7a-cfe3-45af-a3fe-d80b21df0bd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:12.845664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e047a7a-cfe3-45af-a3fe-d80b21df0bd4 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:12.848985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 959/1924] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:12.988449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:13.097157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:13.367380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712374db-93d0-4228-a52c-e2bd7adf9d00 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:13.367691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712374db-93d0-4228-a52c-e2bd7adf9d00 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:13.367956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712374db-93d0-4228-a52c-e2bd7adf9d00 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:13.370292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 966/1925] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:32:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:32:13.377826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755b6ad-01da-4456-8fc9-29c44ea7b2de None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:13.378757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755b6ad-01da-4456-8fc9-29c44ea7b2de None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:13.378853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755b6ad-01da-4456-8fc9-29c44ea7b2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:13.399755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6755b6ad-01da-4456-8fc9-29c44ea7b2de None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:13.401287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6755b6ad-01da-4456-8fc9-29c44ea7b2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:13.495762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 960/1926] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:32:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:13.505219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712374db-93d0-4228-a52c-e2bd7adf9d00 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:13.507907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-712374db-93d0-4228-a52c-e2bd7adf9d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:13.531563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712374db-93d0-4228-a52c-e2bd7adf9d00 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:13.556294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7127ca-c799-4e5c-b2de-3e227065a079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:13.556922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7127ca-c799-4e5c-b2de-3e227065a079 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:13.557197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7127ca-c799-4e5c-b2de-3e227065a079 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:13.557581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7127ca-c799-4e5c-b2de-3e227065a079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:13.574181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7127ca-c799-4e5c-b2de-3e227065a079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:13.575953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7127ca-c799-4e5c-b2de-3e227065a079 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:13.627787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 967/1927] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:14.096732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:14.356229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755b6ad-01da-4456-8fc9-29c44ea7b2de None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:14.358069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6755b6ad-01da-4456-8fc9-29c44ea7b2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:14.424385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755b6ad-01da-4456-8fc9-29c44ea7b2de None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:14.429078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:14.433117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:14.433117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:14.433117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] PATH_INFO: `/v3/users/35693d7d24534da39a027b6e3ce0e96a` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:14.433117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35693d7d24534da39a027b6e3ce0e96a)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:14.433465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:14.512728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:14.653110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35693d7d24534da39a027b6e3ce0e96a'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:14.653777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35693d7d24534da39a027b6e3ce0e96a'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:14.665309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35693d7d24534da39a027b6e3ce0e96a'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:14.672529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35693d7d24534da39a027b6e3ce0e96a'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:14.759232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35693d7d24534da39a027b6e3ce0e96a'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:14.765583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 961/1928] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:14 2022] DELETE /identity/v3/users/35693d7d24534da39a027b6e3ce0e96a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:14.769974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f308e2f-8881-40d1-b587-b61e1bd7acbe None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:14.770588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f308e2f-8881-40d1-b587-b61e1bd7acbe None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:14.770588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f308e2f-8881-40d1-b587-b61e1bd7acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:14.790081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9f308e2f-8881-40d1-b587-b61e1bd7acbe None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:14.791302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9f308e2f-8881-40d1-b587-b61e1bd7acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:14.856501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 968/1929] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:14.866291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:14.867999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:14.926376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da6df-9b1f-457d-a4fe-c2644819e0d5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:14.930190 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37379d71-45b1-4dbd-a1bd-530166dec2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:14.930799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37379d71-45b1-4dbd-a1bd-530166dec2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:14.931081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37379d71-45b1-4dbd-a1bd-530166dec2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:14.931348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37379d71-45b1-4dbd-a1bd-530166dec2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:14.941127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37379d71-45b1-4dbd-a1bd-530166dec2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:14.944244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37379d71-45b1-4dbd-a1bd-530166dec2b3 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:14.955139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 962/1930] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:15.436124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f308e2f-8881-40d1-b587-b61e1bd7acbe None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:15.437605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9f308e2f-8881-40d1-b587-b61e1bd7acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:15.449724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f308e2f-8881-40d1-b587-b61e1bd7acbe None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:15.454263 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:15.454896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:15.455173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:15.455446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] PATH_INFO: `/v3/projects/487b8c75d056488583a7c2b13bc2529f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:15.456632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=487b8c75d056488583a7c2b13bc2529f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:15.458537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:15.571093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487b8c75d056488583a7c2b13bc2529f', 'request_id': 'req-b0abf157-53a9-48fd-b3f4-4dc030d629a4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:15.577747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487b8c75d056488583a7c2b13bc2529f', 'request_id': 'req-b0abf157-53a9-48fd-b3f4-4dc030d629a4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:15.584793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487b8c75d056488583a7c2b13bc2529f', 'request_id': 'req-b0abf157-53a9-48fd-b3f4-4dc030d629a4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:15.730951 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] The token cache is being invalidate because project 487b8c75d056488583a7c2b13bc2529f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:15.731710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:15.732766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:15.735067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 969/1931] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:15 2022] DELETE /identity/v3/projects/487b8c75d056488583a7c2b13bc2529f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:15.739249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37379d71-45b1-4dbd-a1bd-530166dec2b3 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:15.752102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37379d71-45b1-4dbd-a1bd-530166dec2b3 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:15.782991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:15.842670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:15.843409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:15.843625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:15.843910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] PATH_INFO: `/v3/users/f86c177602d44a6cacdb6f558d72ad97` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:15.845759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86c177602d44a6cacdb6f558d72ad97)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:15.849538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:16.134572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86c177602d44a6cacdb6f558d72ad97'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:16.136467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86c177602d44a6cacdb6f558d72ad97'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:16.175006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86c177602d44a6cacdb6f558d72ad97'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:16.186487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86c177602d44a6cacdb6f558d72ad97'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:16.276566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7267301-c66c-46f3-88fd-b497d74cb300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86c177602d44a6cacdb6f558d72ad97'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:16.287189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 963/1932] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:15 2022] DELETE /identity/v3/users/f86c177602d44a6cacdb6f558d72ad97 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:16.423216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:16.725646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:16.727222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:16.741867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abf157-53a9-48fd-b3f4-4dc030d629a4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:16.801832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:16.802448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:16.802637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:16.803580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] PATH_INFO: `/v3/projects/f8f906e41dc04ddc9210f96e355795d5` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:16.804728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f906e41dc04ddc9210f96e355795d5)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:16.806619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:16.920445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f906e41dc04ddc9210f96e355795d5', 'request_id': 'req-a291e3ce-3ea2-4890-8296-4c4b643f11c7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:16.930325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f906e41dc04ddc9210f96e355795d5', 'request_id': 'req-a291e3ce-3ea2-4890-8296-4c4b643f11c7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:16.939185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f906e41dc04ddc9210f96e355795d5', 'request_id': 'req-a291e3ce-3ea2-4890-8296-4c4b643f11c7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:17.071483 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] The token cache is being invalidate because project f8f906e41dc04ddc9210f96e355795d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:17.071781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:17.079161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a291e3ce-3ea2-4890-8296-4c4b643f11c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:17.084859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 970/1933] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:16 2022] DELETE /identity/v3/projects/f8f906e41dc04ddc9210f96e355795d5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:17.090509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f40927-ee31-422b-807b-3f1691adc4b9 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.091125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f40927-ee31-422b-807b-3f1691adc4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.091465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f40927-ee31-422b-807b-3f1691adc4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.127166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f1f40927-ee31-422b-807b-3f1691adc4b9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:17.128467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f1f40927-ee31-422b-807b-3f1691adc4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:17.229503 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 964/1934] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:17.237462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68eda-8aef-4d96-be5a-6233ab42ea9f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.238085 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68eda-8aef-4d96-be5a-6233ab42ea9f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.238556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68eda-8aef-4d96-be5a-6233ab42ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.259216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f40927-ee31-422b-807b-3f1691adc4b9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:17.261407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f1f40927-ee31-422b-807b-3f1691adc4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:17.285356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c7d68eda-8aef-4d96-be5a-6233ab42ea9f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:17.287264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f40927-ee31-422b-807b-3f1691adc4b9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:17.288345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c7d68eda-8aef-4d96-be5a-6233ab42ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:17.304576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:17.305409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.305723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.306859 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] PATH_INFO: `/v3/users/f4748067918b4dc8bd2fe00e86fa2731` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.312122 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4748067918b4dc8bd2fe00e86fa2731)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:17.312273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 971/1935] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:17.313694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:17.317557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68eda-8aef-4d96-be5a-6233ab42ea9f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:17.347434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68eda-8aef-4d96-be5a-6233ab42ea9f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:17.360414 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d873a-a459-43aa-af70-afbf8bc9be98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:17.361388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d873a-a459-43aa-af70-afbf8bc9be98 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.361861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d873a-a459-43aa-af70-afbf8bc9be98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.362342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d873a-a459-43aa-af70-afbf8bc9be98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.363155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d873a-a459-43aa-af70-afbf8bc9be98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:17.363625 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d873a-a459-43aa-af70-afbf8bc9be98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:17.366275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d873a-a459-43aa-af70-afbf8bc9be98 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:17.380039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 972/1936] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:17.384762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d873a-a459-43aa-af70-afbf8bc9be98 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:17.400619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d873a-a459-43aa-af70-afbf8bc9be98 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:17.405619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0a1d1-023c-45e3-be3a-bd1c229ab282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:17.406373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0a1d1-023c-45e3-be3a-bd1c229ab282 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.406564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0a1d1-023c-45e3-be3a-bd1c229ab282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.406819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0a1d1-023c-45e3-be3a-bd1c229ab282 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.407449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0a1d1-023c-45e3-be3a-bd1c229ab282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:17.409568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0a1d1-023c-45e3-be3a-bd1c229ab282 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:17.519187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4748067918b4dc8bd2fe00e86fa2731'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:17.519854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4748067918b4dc8bd2fe00e86fa2731'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:17.534641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4748067918b4dc8bd2fe00e86fa2731'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:17.543461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 973/1937] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:17 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:17.545057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4748067918b4dc8bd2fe00e86fa2731'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:17.548853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0a1d1-023c-45e3-be3a-bd1c229ab282 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:17.617461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0a1d1-023c-45e3-be3a-bd1c229ab282 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:17.622137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b7ac0-1583-46e8-ad68-de60963c9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:17.623215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7ac0-1583-46e8-ad68-de60963c9dbe admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.623215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7ac0-1583-46e8-ad68-de60963c9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.623365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7ac0-1583-46e8-ad68-de60963c9dbe admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.624111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b7ac0-1583-46e8-ad68-de60963c9dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:17.626111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b7ac0-1583-46e8-ad68-de60963c9dbe admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:17.680293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d329930e-9622-4d8f-aa57-3a4154364648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4748067918b4dc8bd2fe00e86fa2731'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:17.687016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 965/1938] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:17 2022] DELETE /identity/v3/users/f4748067918b4dc8bd2fe00e86fa2731 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:17.697382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f25a9-cbfa-4742-b140-a7c06d62272d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.697667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f25a9-cbfa-4742-b140-a7c06d62272d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.697938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f25a9-cbfa-4742-b140-a7c06d62272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.717093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-088f25a9-cbfa-4742-b140-a7c06d62272d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:17.718317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-088f25a9-cbfa-4742-b140-a7c06d62272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:17.727066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 974/1939] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:17 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:17.736990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b7ac0-1583-46e8-ad68-de60963c9dbe admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:17.738571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cf9b7ac0-1583-46e8-ad68-de60963c9dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:17.751298 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b7ac0-1583-46e8-ad68-de60963c9dbe admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:17.778765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 966/1940] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:17.793312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f25a9-cbfa-4742-b140-a7c06d62272d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:17.795073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-088f25a9-cbfa-4742-b140-a7c06d62272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:17.809086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4398a-437d-4d0c-9612-e7e977afae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:17.810372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4398a-437d-4d0c-9612-e7e977afae51 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.810814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4398a-437d-4d0c-9612-e7e977afae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.811293 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4398a-437d-4d0c-9612-e7e977afae51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.812255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4398a-437d-4d0c-9612-e7e977afae51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:17.814416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4398a-437d-4d0c-9612-e7e977afae51 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:17.833524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 975/1941] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:17.837313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4398a-437d-4d0c-9612-e7e977afae51 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:17.849138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4398a-437d-4d0c-9612-e7e977afae51 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:17.854405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281b46-8d82-4a3f-b633-f02068e89a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:17.856384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281b46-8d82-4a3f-b633-f02068e89a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.856384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281b46-8d82-4a3f-b633-f02068e89a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.856384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281b46-8d82-4a3f-b633-f02068e89a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.856384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1281b46-8d82-4a3f-b633-f02068e89a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:17.857776 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1281b46-8d82-4a3f-b633-f02068e89a18 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:17.861631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f25a9-cbfa-4742-b140-a7c06d62272d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:17.866121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125bdce-ef77-405f-bd18-c1d567a32b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:17.867067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125bdce-ef77-405f-bd18-c1d567a32b27 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.867335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125bdce-ef77-405f-bd18-c1d567a32b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.867598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125bdce-ef77-405f-bd18-c1d567a32b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.869394 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 976/1942] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:17.873652 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281b46-8d82-4a3f-b633-f02068e89a18 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:17.878573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125bdce-ef77-405f-bd18-c1d567a32b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:17.883059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125bdce-ef77-405f-bd18-c1d567a32b27 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:17.883158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281b46-8d82-4a3f-b633-f02068e89a18 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:17.887653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c16dbd-c03e-43b0-b944-c25bf5ab53b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:17.888314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c16dbd-c03e-43b0-b944-c25bf5ab53b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:17.888586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c16dbd-c03e-43b0-b944-c25bf5ab53b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:17.888949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c16dbd-c03e-43b0-b944-c25bf5ab53b4 admin admin] PATH_INFO: `/v3/projects/471816ec781d45a3a700129921e53c99/users/0647d02a2e1e434cadc3abeb7318fb0b/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:17.889754 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 967/1943] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:17.903942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c16dbd-c03e-43b0-b944-c25bf5ab53b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=471816ec781d45a3a700129921e53c99, user_id=0647d02a2e1e434cadc3abeb7318fb0b, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:17.906629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c16dbd-c03e-43b0-b944-c25bf5ab53b4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:17.999686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 977/1944] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:17 2022] PUT /identity/v3/projects/471816ec781d45a3a700129921e53c99/users/0647d02a2e1e434cadc3abeb7318fb0b/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:18.010093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9ea11-195f-40cb-885b-129cc37ae950 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:18.010376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9ea11-195f-40cb-885b-129cc37ae950 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:18.010653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9ea11-195f-40cb-885b-129cc37ae950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:18.048089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6ae9ea11-195f-40cb-885b-129cc37ae950 None None] MFA Rules not processed for user `0647d02a2e1e434cadc3abeb7318fb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:18.048089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6ae9ea11-195f-40cb-885b-129cc37ae950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:18.147512 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 968/1945] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:18.151834 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c16dbd-c03e-43b0-b944-c25bf5ab53b4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:18.222357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c16dbd-c03e-43b0-b944-c25bf5ab53b4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:18.228779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fe48f-2c8a-4c78-b96e-477c1fdcfa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:18.229424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fe48f-2c8a-4c78-b96e-477c1fdcfa9f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:18.229698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fe48f-2c8a-4c78-b96e-477c1fdcfa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:18.229968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fe48f-2c8a-4c78-b96e-477c1fdcfa9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:18.230662 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fe48f-2c8a-4c78-b96e-477c1fdcfa9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:18.232689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fe48f-2c8a-4c78-b96e-477c1fdcfa9f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:18.274184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:18.390543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9ea11-195f-40cb-885b-129cc37ae950 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:18.392396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6ae9ea11-195f-40cb-885b-129cc37ae950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:18.407214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 978/1946] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:18 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:18.408364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fe48f-2c8a-4c78-b96e-477c1fdcfa9f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:18.409367 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9ea11-195f-40cb-885b-129cc37ae950 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:18.507826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:18.508010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:18.508196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:18.508610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] PATH_INFO: `/v3/projects/bf00752f895847998c33c465cb28e196` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:18.509745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf00752f895847998c33c465cb28e196)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:18.511663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:18.516126 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fe48f-2c8a-4c78-b96e-477c1fdcfa9f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:18.521276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1f14-6dc5-4166-b29b-65a4ddbe394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:18.523263 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1f14-6dc5-4166-b29b-65a4ddbe394e admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:18.523550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1f14-6dc5-4166-b29b-65a4ddbe394e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:18.524366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1f14-6dc5-4166-b29b-65a4ddbe394e admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:18.524691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c1f14-6dc5-4166-b29b-65a4ddbe394e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:18.526611 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c1f14-6dc5-4166-b29b-65a4ddbe394e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:18.641080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 979/1947] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:18 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:18.644957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1f14-6dc5-4166-b29b-65a4ddbe394e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:18.658018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf00752f895847998c33c465cb28e196', 'request_id': 'req-d706d24c-09fa-4e9f-9002-40a9217e1855'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:18.661701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1f14-6dc5-4166-b29b-65a4ddbe394e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:18.665390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf00752f895847998c33c465cb28e196', 'request_id': 'req-d706d24c-09fa-4e9f-9002-40a9217e1855'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:18.673032 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf00752f895847998c33c465cb28e196', 'request_id': 'req-d706d24c-09fa-4e9f-9002-40a9217e1855'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:18.744891 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19920d-fb9b-4ff5-92f5-7349acd02931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:18.745512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19920d-fb9b-4ff5-92f5-7349acd02931 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:18.745793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19920d-fb9b-4ff5-92f5-7349acd02931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:18.746069 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19920d-fb9b-4ff5-92f5-7349acd02931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:18.746739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19920d-fb9b-4ff5-92f5-7349acd02931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:18.748444 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19920d-fb9b-4ff5-92f5-7349acd02931 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:18.759152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 980/1948] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:18.763266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19920d-fb9b-4ff5-92f5-7349acd02931 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:18.774270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19920d-fb9b-4ff5-92f5-7349acd02931 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:18.779329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadfe59-03fb-4d09-a756-ab8ab43e8299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:18.780014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadfe59-03fb-4d09-a756-ab8ab43e8299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:18.780289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadfe59-03fb-4d09-a756-ab8ab43e8299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:18.780600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadfe59-03fb-4d09-a756-ab8ab43e8299 admin admin] PATH_INFO: `/v3/projects/f09f6d13d2b64938af002e26e13a46f1/users/bf68e707c03a426db9ba7d353b02f953/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:18.797299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadfe59-03fb-4d09-a756-ab8ab43e8299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09f6d13d2b64938af002e26e13a46f1, user_id=bf68e707c03a426db9ba7d353b02f953, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:18.800068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadfe59-03fb-4d09-a756-ab8ab43e8299 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:18.816377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] The token cache is being invalidate because project bf00752f895847998c33c465cb28e196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:18.817002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:18.817766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:18.820889 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 969/1949] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:18 2022] DELETE /identity/v3/projects/bf00752f895847998c33c465cb28e196 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:18.824576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:18.826396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:18.840225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:18.851309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706d24c-09fa-4e9f-9002-40a9217e1855 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:18.859584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:18.860507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:18.862313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:18.862313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] PATH_INFO: `/v3/users/03317c57fa0144a58c8b2f867b16babb` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:18.863208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03317c57fa0144a58c8b2f867b16babb)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:18.865864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:18.922681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 981/1950] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:18 2022] PUT /identity/v3/projects/f09f6d13d2b64938af002e26e13a46f1/users/bf68e707c03a426db9ba7d353b02f953/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:18.926472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadfe59-03fb-4d09-a756-ab8ab43e8299 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:18.928634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8cadfe59-03fb-4d09-a756-ab8ab43e8299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:18.981557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:18.994878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadfe59-03fb-4d09-a756-ab8ab43e8299 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:19.000172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d5a48-56af-4df3-ae29-6c2a23bec2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:19.000857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d5a48-56af-4df3-ae29-6c2a23bec2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:19.001211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d5a48-56af-4df3-ae29-6c2a23bec2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:19.001484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d5a48-56af-4df3-ae29-6c2a23bec2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:19.002182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d5a48-56af-4df3-ae29-6c2a23bec2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:19.003947 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d5a48-56af-4df3-ae29-6c2a23bec2a8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:19.016142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 982/1951] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:19.020283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d5a48-56af-4df3-ae29-6c2a23bec2a8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:19.035005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d5a48-56af-4df3-ae29-6c2a23bec2a8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:19.040736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9a337-7139-4416-9e71-55b338b219e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:19.041388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a337-7139-4416-9e71-55b338b219e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:19.041665 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a337-7139-4416-9e71-55b338b219e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:19.041954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a337-7139-4416-9e71-55b338b219e7 admin admin] PATH_INFO: `/v3/projects/f09f6d13d2b64938af002e26e13a46f1/users/bf68e707c03a426db9ba7d353b02f953/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:19.043906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9a337-7139-4416-9e71-55b338b219e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09f6d13d2b64938af002e26e13a46f1, user_id=bf68e707c03a426db9ba7d353b02f953, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:19.046583 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9a337-7139-4416-9e71-55b338b219e7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:19.064995 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 983/1952] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:19 2022] PUT /identity/v3/projects/f09f6d13d2b64938af002e26e13a46f1/users/bf68e707c03a426db9ba7d353b02f953/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:19.068295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03317c57fa0144a58c8b2f867b16babb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.069610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03317c57fa0144a58c8b2f867b16babb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.071843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace82b8-2b7f-4e04-b6c0-607187733cc7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:19.072577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace82b8-2b7f-4e04-b6c0-607187733cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:19.072857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace82b8-2b7f-4e04-b6c0-607187733cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:19.084663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03317c57fa0144a58c8b2f867b16babb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.091721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03317c57fa0144a58c8b2f867b16babb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.105824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0ace82b8-2b7f-4e04-b6c0-607187733cc7 None None] MFA Rules not processed for user `bf68e707c03a426db9ba7d353b02f953`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:19.109238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0ace82b8-2b7f-4e04-b6c0-607187733cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:19.153459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03317c57fa0144a58c8b2f867b16babb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.161613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 970/1953] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:18 2022] DELETE /identity/v3/users/03317c57fa0144a58c8b2f867b16babb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:19.195684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 984/1954] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:19.207380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:19.208891 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:19.267474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c002e-85fd-4f9e-94ce-27d895cb58d5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:19.271212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e18e0-a2d9-48b8-87c4-19232b088a3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:19.271981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e18e0-a2d9-48b8-87c4-19232b088a3f service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:19.272560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e18e0-a2d9-48b8-87c4-19232b088a3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:19.272830 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e18e0-a2d9-48b8-87c4-19232b088a3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:19.339351 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e18e0-a2d9-48b8-87c4-19232b088a3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:19.340899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e18e0-a2d9-48b8-87c4-19232b088a3f service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:19.352647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 971/1955] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:19.432914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace82b8-2b7f-4e04-b6c0-607187733cc7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:19.434421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0ace82b8-2b7f-4e04-b6c0-607187733cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:19.522895 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace82b8-2b7f-4e04-b6c0-607187733cc7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:19.582695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:19.583365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:19.583645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:19.583937 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] PATH_INFO: `/v3/users/0647d02a2e1e434cadc3abeb7318fb0b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:19.585550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0647d02a2e1e434cadc3abeb7318fb0b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:19.587574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:19.728671 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e18e0-a2d9-48b8-87c4-19232b088a3f service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:19.730086 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e39e18e0-a2d9-48b8-87c4-19232b088a3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:19.746637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e18e0-a2d9-48b8-87c4-19232b088a3f service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:19.751871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:19.752423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:19.752693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:19.753010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] PATH_INFO: `/v3/projects/a6ae4502e3dc40f389fe8404d64bfb0d` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:19.754096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ae4502e3dc40f389fe8404d64bfb0d)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:19.756005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:19.910274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0647d02a2e1e434cadc3abeb7318fb0b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.915419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ae4502e3dc40f389fe8404d64bfb0d', 'request_id': 'req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.921785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ae4502e3dc40f389fe8404d64bfb0d', 'request_id': 'req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.928821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ae4502e3dc40f389fe8404d64bfb0d', 'request_id': 'req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.976385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0647d02a2e1e434cadc3abeb7318fb0b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.984182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0647d02a2e1e434cadc3abeb7318fb0b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.984952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0647d02a2e1e434cadc3abeb7318fb0b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:19.997254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-35818ede-f61c-4b73-9b7f-0b553f5f08bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0647d02a2e1e434cadc3abeb7318fb0b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:20.003274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 985/1956] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:19 2022] DELETE /identity/v3/users/0647d02a2e1e434cadc3abeb7318fb0b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:20.008898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87499fd-f36e-40c0-bb5b-9bce52d870c9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.008898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87499fd-f36e-40c0-bb5b-9bce52d870c9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.009092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87499fd-f36e-40c0-bb5b-9bce52d870c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.028912 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c87499fd-f36e-40c0-bb5b-9bce52d870c9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:20.030133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c87499fd-f36e-40c0-bb5b-9bce52d870c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:20.075036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:20.090776 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 986/1957] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:20.103481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87499fd-f36e-40c0-bb5b-9bce52d870c9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:20.105683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c87499fd-f36e-40c0-bb5b-9bce52d870c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:20.119725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] The token cache is being invalidate because project a6ae4502e3dc40f389fe8404d64bfb0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:20.120099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:20.124127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d522ce80-d3f5-4e1a-9d05-bdf6e4bd581a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:20.124127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 972/1958] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:19 2022] DELETE /identity/v3/projects/a6ae4502e3dc40f389fe8404d64bfb0d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:20.129235 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8d4db-380b-48c6-85e3-fdff139c32f6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.129530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8d4db-380b-48c6-85e3-fdff139c32f6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.129804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8d4db-380b-48c6-85e3-fdff139c32f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.152531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d8c8d4db-380b-48c6-85e3-fdff139c32f6 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:20.153853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d8c8d4db-380b-48c6-85e3-fdff139c32f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:20.170114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 973/1959] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:20.172049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe785a1-f029-4bf0-88a1-139ded065110 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.172481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe785a1-f029-4bf0-88a1-139ded065110 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.172913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe785a1-f029-4bf0-88a1-139ded065110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.196133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-afe785a1-f029-4bf0-88a1-139ded065110 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:20.197567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-afe785a1-f029-4bf0-88a1-139ded065110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:20.206411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 974/1960] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:20.215874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe785a1-f029-4bf0-88a1-139ded065110 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:20.222856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87499fd-f36e-40c0-bb5b-9bce52d870c9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:20.224365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe785a1-f029-4bf0-88a1-139ded065110 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:20.232361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13037dd9-d59d-48d9-ad9e-89cdf8c934cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:20.233027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c73243-bbdd-4154-b889-9b687006e2e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:20.233168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13037dd9-d59d-48d9-ad9e-89cdf8c934cc admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.233793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c73243-bbdd-4154-b889-9b687006e2e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.234037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13037dd9-d59d-48d9-ad9e-89cdf8c934cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.234204 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c73243-bbdd-4154-b889-9b687006e2e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.234543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c73243-bbdd-4154-b889-9b687006e2e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.234646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13037dd9-d59d-48d9-ad9e-89cdf8c934cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.235415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13037dd9-d59d-48d9-ad9e-89cdf8c934cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:20.235729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13037dd9-d59d-48d9-ad9e-89cdf8c934cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:20.237410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-65c73243-bbdd-4154-b889-9b687006e2e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:20.239395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13037dd9-d59d-48d9-ad9e-89cdf8c934cc admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:20.252812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 975/1961] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:32:20.258168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13037dd9-d59d-48d9-ad9e-89cdf8c934cc admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:20.264755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c73243-bbdd-4154-b889-9b687006e2e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:20.266445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c73243-bbdd-4154-b889-9b687006e2e0 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:20.280167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 987/1962] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:20.296638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13037dd9-d59d-48d9-ad9e-89cdf8c934cc admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:20.301747 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d12966-5674-424d-aa8e-02720eb13ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:20.302365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d12966-5674-424d-aa8e-02720eb13ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.304013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d12966-5674-424d-aa8e-02720eb13ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.304301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d12966-5674-424d-aa8e-02720eb13ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.304984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d12966-5674-424d-aa8e-02720eb13ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:20.307835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d12966-5674-424d-aa8e-02720eb13ddd admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:20.413486 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 976/1963] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:20 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:20.414138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c73243-bbdd-4154-b889-9b687006e2e0 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:20.426388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c73243-bbdd-4154-b889-9b687006e2e0 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:20.515650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38692c64-9d0b-418a-aded-40f52c8ae7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:20.516857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38692c64-9d0b-418a-aded-40f52c8ae7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.517142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38692c64-9d0b-418a-aded-40f52c8ae7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.517410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38692c64-9d0b-418a-aded-40f52c8ae7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.518242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38692c64-9d0b-418a-aded-40f52c8ae7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:20.522851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38692c64-9d0b-418a-aded-40f52c8ae7b0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:20.618777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 988/1964] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:20 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:20.623099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d12966-5674-424d-aa8e-02720eb13ddd admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:20.640175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d12966-5674-424d-aa8e-02720eb13ddd admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:20.659998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fe708-e8d9-4b27-8d5b-261cb90f0ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:20.660633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fe708-e8d9-4b27-8d5b-261cb90f0ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.660913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fe708-e8d9-4b27-8d5b-261cb90f0ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.661179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fe708-e8d9-4b27-8d5b-261cb90f0ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.661832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fe708-e8d9-4b27-8d5b-261cb90f0ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:20.664169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fe708-e8d9-4b27-8d5b-261cb90f0ee7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:20.684686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 977/1965] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:20.687875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38692c64-9d0b-418a-aded-40f52c8ae7b0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:20.701826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38692c64-9d0b-418a-aded-40f52c8ae7b0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:20.708435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e58b3-9edd-4227-8af3-d71914ef1a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:20.709454 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e58b3-9edd-4227-8af3-d71914ef1a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.710924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e58b3-9edd-4227-8af3-d71914ef1a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.716559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e58b3-9edd-4227-8af3-d71914ef1a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.716559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e58b3-9edd-4227-8af3-d71914ef1a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:20.716559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e58b3-9edd-4227-8af3-d71914ef1a4f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:20.731079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 989/1966] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:20.735333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fe708-e8d9-4b27-8d5b-261cb90f0ee7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:20.746997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fe708-e8d9-4b27-8d5b-261cb90f0ee7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:20.754139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ea588-ab22-40d9-b270-2532b17a645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:20.755114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ea588-ab22-40d9-b270-2532b17a645e admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.755561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ea588-ab22-40d9-b270-2532b17a645e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.756031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ea588-ab22-40d9-b270-2532b17a645e admin admin] PATH_INFO: `/v3/projects/2337852ebdf14b8a872e495d39209a30/users/1af2e5d99b9f4db297775ce718e8f574/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.775298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ea588-ab22-40d9-b270-2532b17a645e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2337852ebdf14b8a872e495d39209a30, user_id=1af2e5d99b9f4db297775ce718e8f574, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:20.777831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ea588-ab22-40d9-b270-2532b17a645e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:20.794399 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:20.873726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e58b3-9edd-4227-8af3-d71914ef1a4f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:20.875806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-aa9e58b3-9edd-4227-8af3-d71914ef1a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:20.906947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 978/1967] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:20 2022] PUT /identity/v3/projects/2337852ebdf14b8a872e495d39209a30/users/1af2e5d99b9f4db297775ce718e8f574/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:20.918786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7c379-bd1e-4baa-82ab-8e1e5f2a9b46 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:20.919074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7c379-bd1e-4baa-82ab-8e1e5f2a9b46 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:20.919352 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7c379-bd1e-4baa-82ab-8e1e5f2a9b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:20.951580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-cfe7c379-bd1e-4baa-82ab-8e1e5f2a9b46 None None] MFA Rules not processed for user `1af2e5d99b9f4db297775ce718e8f574`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:20.952960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-cfe7c379-bd1e-4baa-82ab-8e1e5f2a9b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:21.000069 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e58b3-9edd-4227-8af3-d71914ef1a4f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:21.057996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999067e-917e-4af5-b402-fa7066e58ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:21.058782 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999067e-917e-4af5-b402-fa7066e58ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:21.059089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999067e-917e-4af5-b402-fa7066e58ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:21.059367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999067e-917e-4af5-b402-fa7066e58ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:21.060149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 979/1968] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:21.065114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7c379-bd1e-4baa-82ab-8e1e5f2a9b46 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:21.066532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b999067e-917e-4af5-b402-fa7066e58ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:21.113477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:21.136480 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999067e-917e-4af5-b402-fa7066e58ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:21.137945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999067e-917e-4af5-b402-fa7066e58ac4 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:21.141064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7c379-bd1e-4baa-82ab-8e1e5f2a9b46 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:21.146179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60ea3-fc01-4598-a214-839ddaf9579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:21.148096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 990/1969] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:21.148476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60ea3-fc01-4598-a214-839ddaf9579c admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:21.148825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60ea3-fc01-4598-a214-839ddaf9579c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:21.149115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60ea3-fc01-4598-a214-839ddaf9579c admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:21.149816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60ea3-fc01-4598-a214-839ddaf9579c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:21.151748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60ea3-fc01-4598-a214-839ddaf9579c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:21.225922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999067e-917e-4af5-b402-fa7066e58ac4 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:21.227672 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b999067e-917e-4af5-b402-fa7066e58ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:21.231832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 980/1970] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:21 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:21.235714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60ea3-fc01-4598-a214-839ddaf9579c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:21.248421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999067e-917e-4af5-b402-fa7066e58ac4 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:21.329245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:21.329885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:21.330164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:21.331519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] PATH_INFO: `/v3/projects/471816ec781d45a3a700129921e53c99` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:21.331628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=471816ec781d45a3a700129921e53c99)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:21.331978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60ea3-fc01-4598-a214-839ddaf9579c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:21.333506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:21.338070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f7de-1702-4a01-908a-38ead7791fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:21.338683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f7de-1702-4a01-908a-38ead7791fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:21.338989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f7de-1702-4a01-908a-38ead7791fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:21.339263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f7de-1702-4a01-908a-38ead7791fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:21.339931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993f7de-1702-4a01-908a-38ead7791fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:21.342787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993f7de-1702-4a01-908a-38ead7791fa0 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:21.418937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 981/1971] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:21 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:21.422828 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f7de-1702-4a01-908a-38ead7791fa0 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:21.437919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f7de-1702-4a01-908a-38ead7791fa0 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:21.456795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471816ec781d45a3a700129921e53c99', 'request_id': 'req-cdc35821-e31d-4dd6-a389-7dc798f383f0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:21.464321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471816ec781d45a3a700129921e53c99', 'request_id': 'req-cdc35821-e31d-4dd6-a389-7dc798f383f0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:21.471283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471816ec781d45a3a700129921e53c99', 'request_id': 'req-cdc35821-e31d-4dd6-a389-7dc798f383f0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:21.510703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f27f-cdbf-4803-9550-4e8d85a9e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:21.511326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f27f-cdbf-4803-9550-4e8d85a9e9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:21.511603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f27f-cdbf-4803-9550-4e8d85a9e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:21.511876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f27f-cdbf-4803-9550-4e8d85a9e9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:21.512559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66f27f-cdbf-4803-9550-4e8d85a9e9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:21.514166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66f27f-cdbf-4803-9550-4e8d85a9e9c8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:21.528491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 982/1972] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:21.529176 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f27f-cdbf-4803-9550-4e8d85a9e9c8 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:21.540293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f27f-cdbf-4803-9550-4e8d85a9e9c8 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:21.545999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24461566-6d46-4a3c-b817-d97f3f264be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:21.546676 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461566-6d46-4a3c-b817-d97f3f264be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:21.546954 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461566-6d46-4a3c-b817-d97f3f264be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:21.547233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461566-6d46-4a3c-b817-d97f3f264be9 admin admin] PATH_INFO: `/v3/projects/6c7954d2e5da413394940383a9e888f5/users/ef77059070e04a568f9cb256c9930c5b/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:21.565037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24461566-6d46-4a3c-b817-d97f3f264be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7954d2e5da413394940383a9e888f5, user_id=ef77059070e04a568f9cb256c9930c5b, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:21.571198 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24461566-6d46-4a3c-b817-d97f3f264be9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:21.610267 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] The token cache is being invalidate because project 471816ec781d45a3a700129921e53c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:21.610584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:21.611228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:21.612814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 991/1973] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:21 2022] DELETE /identity/v3/projects/471816ec781d45a3a700129921e53c99 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:21.617343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:21.618947 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:21.632124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc35821-e31d-4dd6-a389-7dc798f383f0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:21.636837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:21.638768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:21.642060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:21.642060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] PATH_INFO: `/v3/users/bf68e707c03a426db9ba7d353b02f953` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:21.642060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf68e707c03a426db9ba7d353b02f953)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:21.642463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:21.668275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 983/1974] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:21 2022] PUT /identity/v3/projects/6c7954d2e5da413394940383a9e888f5/users/ef77059070e04a568f9cb256c9930c5b/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:21.672603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24461566-6d46-4a3c-b817-d97f3f264be9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:21.674280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-24461566-6d46-4a3c-b817-d97f3f264be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:21.748392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24461566-6d46-4a3c-b817-d97f3f264be9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:21.753275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cd6bf-c422-4aee-8e44-831831d9f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:21.753814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cd6bf-c422-4aee-8e44-831831d9f39c admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:21.754090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cd6bf-c422-4aee-8e44-831831d9f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:21.754359 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cd6bf-c422-4aee-8e44-831831d9f39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:21.755030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cd6bf-c422-4aee-8e44-831831d9f39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:21.757716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cd6bf-c422-4aee-8e44-831831d9f39c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:21.767848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 984/1975] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:21.768766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cd6bf-c422-4aee-8e44-831831d9f39c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:21.770869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f83cd6bf-c422-4aee-8e44-831831d9f39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:21.784814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cd6bf-c422-4aee-8e44-831831d9f39c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:21.790050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:21.790683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:21.790954 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:21.791281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] PATH_INFO: `/v3/users/950495fc245b4e35ab01e56ce02f2154` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:21.792556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950495fc245b4e35ab01e56ce02f2154)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:21.794478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:21.802172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:21.864460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf68e707c03a426db9ba7d353b02f953'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:21.953628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf68e707c03a426db9ba7d353b02f953'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:21.962132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf68e707c03a426db9ba7d353b02f953'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:21.963149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf68e707c03a426db9ba7d353b02f953'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:21.978981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf68e707c03a426db9ba7d353b02f953'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:21.988052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 992/1976] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:21 2022] DELETE /identity/v3/users/bf68e707c03a426db9ba7d353b02f953 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:21.988862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:21.992355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:22.063675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950495fc245b4e35ab01e56ce02f2154'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:22.065503 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950495fc245b4e35ab01e56ce02f2154'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:22.086807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:22.094182 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950495fc245b4e35ab01e56ce02f2154'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:22.105477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950495fc245b4e35ab01e56ce02f2154'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:22.141797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490e642-46d7-4fed-9855-b9f2fd0df422 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:22.148353 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f0066-bee5-4639-9ea1-5d404350b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:22.149159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f0066-bee5-4639-9ea1-5d404350b42e admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:22.149503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f0066-bee5-4639-9ea1-5d404350b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:22.149863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f0066-bee5-4639-9ea1-5d404350b42e admin admin] PATH_INFO: `/v3/projects/6c7954d2e5da413394940383a9e888f5/users/ef77059070e04a568f9cb256c9930c5b/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:22.152920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f0066-bee5-4639-9ea1-5d404350b42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7954d2e5da413394940383a9e888f5, user_id=ef77059070e04a568f9cb256c9930c5b, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:22.155949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f0066-bee5-4639-9ea1-5d404350b42e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:22.183967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 993/1977] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:21 2022] PUT /identity/v3/projects/6c7954d2e5da413394940383a9e888f5/users/ef77059070e04a568f9cb256c9930c5b/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:22.186981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f2a45-cd3c-4d1b-92d7-b116d9d1035f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:22.186981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f2a45-cd3c-4d1b-92d7-b116d9d1035f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:22.186981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f2a45-cd3c-4d1b-92d7-b116d9d1035f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:22.221451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d73f2a45-cd3c-4d1b-92d7-b116d9d1035f None None] MFA Rules not processed for user `ef77059070e04a568f9cb256c9930c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:22.223022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d73f2a45-cd3c-4d1b-92d7-b116d9d1035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:22.267756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:22.268816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f06148d1-9e5d-4958-a43f-d2dce839c641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950495fc245b4e35ab01e56ce02f2154'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:22.279118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 985/1978] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:21 2022] DELETE /identity/v3/users/950495fc245b4e35ab01e56ce02f2154 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:22.280934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe7a64-6770-443c-8679-e206b0a05daf None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:22.281287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe7a64-6770-443c-8679-e206b0a05daf None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:22.281680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe7a64-6770-443c-8679-e206b0a05daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:22.315009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-46fe7a64-6770-443c-8679-e206b0a05daf None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:22.320083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-46fe7a64-6770-443c-8679-e206b0a05daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:22.348074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 994/1979] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:22.362257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f2a45-cd3c-4d1b-92d7-b116d9d1035f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:22.368711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d73f2a45-cd3c-4d1b-92d7-b116d9d1035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:22.451730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 986/1980] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:22.452624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe7a64-6770-443c-8679-e206b0a05daf None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:22.452802 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f2a45-cd3c-4d1b-92d7-b116d9d1035f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:22.457508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-46fe7a64-6770-443c-8679-e206b0a05daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:22.459508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:22.460326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:22.460620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:22.460900 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] PATH_INFO: `/v3/users/36e81e154caa4bc58b6395dfd7af3c86` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:22.462230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e81e154caa4bc58b6395dfd7af3c86)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:22.464448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:22.577632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe7a64-6770-443c-8679-e206b0a05daf None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:22.581510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d4dd0-4805-4fc1-8396-01363f5f44a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:22.582125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d4dd0-4805-4fc1-8396-01363f5f44a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:22.582406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d4dd0-4805-4fc1-8396-01363f5f44a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:22.582681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d4dd0-4805-4fc1-8396-01363f5f44a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:22.663588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d4dd0-4805-4fc1-8396-01363f5f44a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:22.665124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d4dd0-4805-4fc1-8396-01363f5f44a0 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:22.675200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 987/1981] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:22.685508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d4dd0-4805-4fc1-8396-01363f5f44a0 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:22.688654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-372d4dd0-4805-4fc1-8396-01363f5f44a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:22.696098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e81e154caa4bc58b6395dfd7af3c86'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:22.775719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e81e154caa4bc58b6395dfd7af3c86'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:22.784874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e81e154caa4bc58b6395dfd7af3c86'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:22.785663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e81e154caa4bc58b6395dfd7af3c86'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:22.795330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d4dd0-4805-4fc1-8396-01363f5f44a0 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:22.802947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39da6e5-a315-4bc7-8b57-b61565b243bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:22.804491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da6e5-a315-4bc7-8b57-b61565b243bf service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:22.805631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da6e5-a315-4bc7-8b57-b61565b243bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:22.806204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da6e5-a315-4bc7-8b57-b61565b243bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:22.810333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f39da6e5-a315-4bc7-8b57-b61565b243bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:22.814994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e81e154caa4bc58b6395dfd7af3c86'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:22.851620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 995/1982] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:22 2022] DELETE /identity/v3/users/36e81e154caa4bc58b6395dfd7af3c86 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:22.851620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:22.856484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:22.863234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39da6e5-a315-4bc7-8b57-b61565b243bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:22.864723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39da6e5-a315-4bc7-8b57-b61565b243bf service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:22.895240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 988/1983] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:22.899523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6636-10b6-42c8-9bc1-2de93392caa7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:22.899805 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6636-10b6-42c8-9bc1-2de93392caa7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:22.900118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6636-10b6-42c8-9bc1-2de93392caa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:22.928735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-78da6636-10b6-42c8-9bc1-2de93392caa7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:22.930884 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-78da6636-10b6-42c8-9bc1-2de93392caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:22.982125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094cbac-7676-40c9-b198-1dae2b2074ab admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:22.993319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:22.994426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:22.994881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:22.995300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] PATH_INFO: `/v3/projects/f09f6d13d2b64938af002e26e13a46f1` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:22.996857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09f6d13d2b64938af002e26e13a46f1)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:22.998927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:23.053280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 989/1984] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:23.054295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6636-10b6-42c8-9bc1-2de93392caa7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:23.055780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-78da6636-10b6-42c8-9bc1-2de93392caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:23.141018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6636-10b6-42c8-9bc1-2de93392caa7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:23.156246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09f6d13d2b64938af002e26e13a46f1', 'request_id': 'req-6959a0f9-1191-49d7-ba34-35c763a3568c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:23.167814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09f6d13d2b64938af002e26e13a46f1', 'request_id': 'req-6959a0f9-1191-49d7-ba34-35c763a3568c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:23.181816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09f6d13d2b64938af002e26e13a46f1', 'request_id': 'req-6959a0f9-1191-49d7-ba34-35c763a3568c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:23.218316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6805a-5147-43ae-bd9c-f3a6548100fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:23.218945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6805a-5147-43ae-bd9c-f3a6548100fc service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:23.219221 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6805a-5147-43ae-bd9c-f3a6548100fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:23.219497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6805a-5147-43ae-bd9c-f3a6548100fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:23.222219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1ba6805a-5147-43ae-bd9c-f3a6548100fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:23.298644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] The token cache is being invalidate because project f09f6d13d2b64938af002e26e13a46f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:23.298946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:23.299744 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:23.301551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 996/1985] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:22 2022] DELETE /identity/v3/projects/f09f6d13d2b64938af002e26e13a46f1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:23.306629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:23.306629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:23.347231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6805a-5147-43ae-bd9c-f3a6548100fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:23.348777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6805a-5147-43ae-bd9c-f3a6548100fc service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:23.359080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:23.368153 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 990/1986] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:23.369708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf356cb-1584-4bed-9959-1febcd1e6bc0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:23.370260 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf356cb-1584-4bed-9959-1febcd1e6bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:23.370681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf356cb-1584-4bed-9959-1febcd1e6bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:23.401004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5bf356cb-1584-4bed-9959-1febcd1e6bc0 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:23.402228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5bf356cb-1584-4bed-9959-1febcd1e6bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:23.447942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959a0f9-1191-49d7-ba34-35c763a3568c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:23.448541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e6ad9-d68a-4dd4-b355-adcefa2dbc02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:23.449176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e6ad9-d68a-4dd4-b355-adcefa2dbc02 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:23.449455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e6ad9-d68a-4dd4-b355-adcefa2dbc02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:23.449777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e6ad9-d68a-4dd4-b355-adcefa2dbc02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:23.455602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-032e6ad9-d68a-4dd4-b355-adcefa2dbc02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:23.528836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 991/1987] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:23.536846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543007b-348c-4d12-b41a-37f76fa821a8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:23.538106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543007b-348c-4d12-b41a-37f76fa821a8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:23.538470 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543007b-348c-4d12-b41a-37f76fa821a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:23.566166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e6ad9-d68a-4dd4-b355-adcefa2dbc02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:23.568398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e6ad9-d68a-4dd4-b355-adcefa2dbc02 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:23.569950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2543007b-348c-4d12-b41a-37f76fa821a8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:23.571191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2543007b-348c-4d12-b41a-37f76fa821a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:23.582428 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 992/1988] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:23.586579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543007b-348c-4d12-b41a-37f76fa821a8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:23.588617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 997/1989] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:23.597072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543007b-348c-4d12-b41a-37f76fa821a8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:23.602955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b73320-d748-4ef4-9976-e445b79ea809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:23.603980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b73320-d748-4ef4-9976-e445b79ea809 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:23.604558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b73320-d748-4ef4-9976-e445b79ea809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:23.604873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b73320-d748-4ef4-9976-e445b79ea809 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:23.605990 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b73320-d748-4ef4-9976-e445b79ea809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:23.606088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b73320-d748-4ef4-9976-e445b79ea809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:23.608204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b73320-d748-4ef4-9976-e445b79ea809 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:23.627478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 993/1990] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:32:23.633554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e6ad9-d68a-4dd4-b355-adcefa2dbc02 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:23.645455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:23.647228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e6ad9-d68a-4dd4-b355-adcefa2dbc02 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:23.652913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf0deb-af5d-443d-8844-d4c8703414f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:23.653537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf0deb-af5d-443d-8844-d4c8703414f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:23.653818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf0deb-af5d-443d-8844-d4c8703414f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:23.654091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf0deb-af5d-443d-8844-d4c8703414f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:23.654735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf0deb-af5d-443d-8844-d4c8703414f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:23.657957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf0deb-af5d-443d-8844-d4c8703414f2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:23.823310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 998/1991] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:23 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:23.828155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b73320-d748-4ef4-9976-e445b79ea809 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:23.839770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b73320-d748-4ef4-9976-e445b79ea809 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:23.931009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f194b7-8241-42be-becd-8887eacb2b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:23.931774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f194b7-8241-42be-becd-8887eacb2b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:23.932183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f194b7-8241-42be-becd-8887eacb2b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:23.932487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f194b7-8241-42be-becd-8887eacb2b23 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:23.933122 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f194b7-8241-42be-becd-8887eacb2b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:23.936127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f194b7-8241-42be-becd-8887eacb2b23 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:24.065075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 994/1992] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:23 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:24.066119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf0deb-af5d-443d-8844-d4c8703414f2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:24.077115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf0deb-af5d-443d-8844-d4c8703414f2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:24.082023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ccea5-8364-4867-9120-cca1ebd1d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:24.082682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ccea5-8364-4867-9120-cca1ebd1d1dc admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:24.082954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ccea5-8364-4867-9120-cca1ebd1d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:24.083440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ccea5-8364-4867-9120-cca1ebd1d1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:24.084772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ccea5-8364-4867-9120-cca1ebd1d1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:24.086250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ccea5-8364-4867-9120-cca1ebd1d1dc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:24.097176 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 999/1993] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:24.101936 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f194b7-8241-42be-becd-8887eacb2b23 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:24.111759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f194b7-8241-42be-becd-8887eacb2b23 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:24.122490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2e8b-6b2a-4f82-b5ce-742739cd6cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:24.122490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2e8b-6b2a-4f82-b5ce-742739cd6cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:24.122490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2e8b-6b2a-4f82-b5ce-742739cd6cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:24.122490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2e8b-6b2a-4f82-b5ce-742739cd6cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:24.122846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d2e8b-6b2a-4f82-b5ce-742739cd6cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:24.122846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d2e8b-6b2a-4f82-b5ce-742739cd6cf4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:24.132818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 995/1994] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:24.137224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ccea5-8364-4867-9120-cca1ebd1d1dc admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:24.149859 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2e8b-6b2a-4f82-b5ce-742739cd6cf4 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:24.151693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b65d2e8b-6b2a-4f82-b5ce-742739cd6cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:24.152036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ccea5-8364-4867-9120-cca1ebd1d1dc admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:24.157205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce159a3-b206-4f7e-8747-98f88169a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:24.157753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce159a3-b206-4f7e-8747-98f88169a457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:24.157753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce159a3-b206-4f7e-8747-98f88169a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:24.157910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce159a3-b206-4f7e-8747-98f88169a457 admin admin] PATH_INFO: `/v3/projects/ed19683e72e04a83878ba21470720299/users/3745f3c22de4446e8f0327c10cf79c4f/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:24.166799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2e8b-6b2a-4f82-b5ce-742739cd6cf4 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:24.171695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:24.172363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:24.172646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:24.172923 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] PATH_INFO: `/v3/projects/afbb997c85284c62ab7f7857fad91d6f` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:24.174050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=afbb997c85284c62ab7f7857fad91d6f)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:24.174538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce159a3-b206-4f7e-8747-98f88169a457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed19683e72e04a83878ba21470720299, user_id=3745f3c22de4446e8f0327c10cf79c4f, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:24.176670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:24.177488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce159a3-b206-4f7e-8747-98f88169a457 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:24.263801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1000/1995] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:24 2022] PUT /identity/v3/projects/ed19683e72e04a83878ba21470720299/users/3745f3c22de4446e8f0327c10cf79c4f/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:24.266137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce159a3-b206-4f7e-8747-98f88169a457 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:24.266951 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fce159a3-b206-4f7e-8747-98f88169a457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:24.330890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbb997c85284c62ab7f7857fad91d6f', 'request_id': 'req-058aa557-1e94-4357-a73b-bf7930a34fdf'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.337435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbb997c85284c62ab7f7857fad91d6f', 'request_id': 'req-058aa557-1e94-4357-a73b-bf7930a34fdf'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.344685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce159a3-b206-4f7e-8747-98f88169a457 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:24.344890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbb997c85284c62ab7f7857fad91d6f', 'request_id': 'req-058aa557-1e94-4357-a73b-bf7930a34fdf'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.406485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:24.407211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:24.407496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:24.407773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] PATH_INFO: `/v3/projects/c5493f7e62384a319cf90cbecb721d09` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:24.409078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5493f7e62384a319cf90cbecb721d09)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:24.411228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:24.438677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] The token cache is being invalidate because project afbb997c85284c62ab7f7857fad91d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:24.439145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.439665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-058aa557-1e94-4357-a73b-bf7930a34fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.441503 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 996/1996] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:24 2022] DELETE /identity/v3/projects/afbb997c85284c62ab7f7857fad91d6f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:24.442733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d320bd-fd24-4535-af14-055b7cf035e6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:24.443015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d320bd-fd24-4535-af14-055b7cf035e6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:24.443920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d320bd-fd24-4535-af14-055b7cf035e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:24.475037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-52d320bd-fd24-4535-af14-055b7cf035e6 None None] MFA Rules not processed for user `3745f3c22de4446e8f0327c10cf79c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:24.476271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-52d320bd-fd24-4535-af14-055b7cf035e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:24.547379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 997/1997] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:24.549233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d320bd-fd24-4535-af14-055b7cf035e6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:24.549640 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-52d320bd-fd24-4535-af14-055b7cf035e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:24.574858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d320bd-fd24-4535-af14-055b7cf035e6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:24.579953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5493f7e62384a319cf90cbecb721d09', 'request_id': 'req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.587263 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5493f7e62384a319cf90cbecb721d09', 'request_id': 'req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.593842 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5493f7e62384a319cf90cbecb721d09', 'request_id': 'req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.639344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:24.639344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:24.639344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:24.639344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] PATH_INFO: `/v3/users/b28bf78ca97547cf8a00ed08e10e036c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:24.639667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28bf78ca97547cf8a00ed08e10e036c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:24.641150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:24.657376 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:24.721156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] The token cache is being invalidate because project c5493f7e62384a319cf90cbecb721d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:24.721361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.722005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.723532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1001/1998] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:24 2022] DELETE /identity/v3/projects/c5493f7e62384a319cf90cbecb721d09 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:24.724340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:24.725657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:24.787627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cdd96-6c9a-448f-aa29-2ce59de62a02 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:24.791438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6ae61-9036-45bd-90ab-24829a7b4988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:24.792141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6ae61-9036-45bd-90ab-24829a7b4988 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:24.792452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6ae61-9036-45bd-90ab-24829a7b4988 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:24.792724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6ae61-9036-45bd-90ab-24829a7b4988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:24.794487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-42b6ae61-9036-45bd-90ab-24829a7b4988 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:24.858410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6ae61-9036-45bd-90ab-24829a7b4988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:24.858977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28bf78ca97547cf8a00ed08e10e036c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.859633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28bf78ca97547cf8a00ed08e10e036c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.859923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6ae61-9036-45bd-90ab-24829a7b4988 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:24.870082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1002/1999] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:24.870965 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6ae61-9036-45bd-90ab-24829a7b4988 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:24.872667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-42b6ae61-9036-45bd-90ab-24829a7b4988 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:24.872965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28bf78ca97547cf8a00ed08e10e036c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.880836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28bf78ca97547cf8a00ed08e10e036c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.887511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6ae61-9036-45bd-90ab-24829a7b4988 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:24.892511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:24.893158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:24.895364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:24.895364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] PATH_INFO: `/v3/users/e683129cd0a0457b85f2edd5faa2969c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:24.895364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e683129cd0a0457b85f2edd5faa2969c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:24.898138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:24.952326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28bf78ca97547cf8a00ed08e10e036c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:24.964875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 998/2000] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:24 2022] DELETE /identity/v3/users/b28bf78ca97547cf8a00ed08e10e036c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:24.965791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:24.967163 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:25.047363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e52a5f-dc9c-4918-a678-bf5b6a34c740 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:25.052207 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:25.053394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:25.053673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:25.053947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] PATH_INFO: `/v3/users/3745f3c22de4446e8f0327c10cf79c4f` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:25.055101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3745f3c22de4446e8f0327c10cf79c4f)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:25.057068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:25.157481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e683129cd0a0457b85f2edd5faa2969c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.256395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e683129cd0a0457b85f2edd5faa2969c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.264981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e683129cd0a0457b85f2edd5faa2969c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.265848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e683129cd0a0457b85f2edd5faa2969c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.271201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3745f3c22de4446e8f0327c10cf79c4f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.271899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3745f3c22de4446e8f0327c10cf79c4f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.279281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fcb3db7e-9500-4a4e-a77c-655e8671dee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e683129cd0a0457b85f2edd5faa2969c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.285061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3745f3c22de4446e8f0327c10cf79c4f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.287830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1003/2001] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:24 2022] DELETE /identity/v3/users/e683129cd0a0457b85f2edd5faa2969c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:25.297999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3745f3c22de4446e8f0327c10cf79c4f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.398211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3745f3c22de4446e8f0327c10cf79c4f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.406358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 999/2002] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:24 2022] DELETE /identity/v3/users/3745f3c22de4446e8f0327c10cf79c4f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:25.411488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc092fd-a0db-4685-b347-6a8c258d2847 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:25.411772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc092fd-a0db-4685-b347-6a8c258d2847 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:25.412725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc092fd-a0db-4685-b347-6a8c258d2847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:25.445921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4fc092fd-a0db-4685-b347-6a8c258d2847 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:25.448396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4fc092fd-a0db-4685-b347-6a8c258d2847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:25.457184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:25.470826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:25.473250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:25.557977 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1004/2003] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:25.567822 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc092fd-a0db-4685-b347-6a8c258d2847 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:25.569366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4fc092fd-a0db-4685-b347-6a8c258d2847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:25.573850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1e7d-b2c5-4002-ad77-560b90acb987 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:25.578546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:25.579172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:25.579451 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:25.579721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] PATH_INFO: `/v3/projects/810cd2860c0a4d6c8c9086a70d18ea12` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:25.580915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=810cd2860c0a4d6c8c9086a70d18ea12)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:25.582829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:25.627079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc092fd-a0db-4685-b347-6a8c258d2847 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:25.630777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879d215-2b1f-4dff-90b5-72c30c9c605e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:25.631375 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d215-2b1f-4dff-90b5-72c30c9c605e service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:25.631653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d215-2b1f-4dff-90b5-72c30c9c605e service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:25.631985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d215-2b1f-4dff-90b5-72c30c9c605e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:25.640783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879d215-2b1f-4dff-90b5-72c30c9c605e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:25.642199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879d215-2b1f-4dff-90b5-72c30c9c605e service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:25.652407 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1005/2004] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:25.746918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810cd2860c0a4d6c8c9086a70d18ea12', 'request_id': 'req-1c5d71c6-897d-4b4c-ab77-539f1863d07e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.763039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810cd2860c0a4d6c8c9086a70d18ea12', 'request_id': 'req-1c5d71c6-897d-4b4c-ab77-539f1863d07e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.778268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810cd2860c0a4d6c8c9086a70d18ea12', 'request_id': 'req-1c5d71c6-897d-4b4c-ab77-539f1863d07e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.903836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] The token cache is being invalidate because project 810cd2860c0a4d6c8c9086a70d18ea12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:25.904151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.905362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1c5d71c6-897d-4b4c-ab77-539f1863d07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:25.906665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1000/2005] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:25 2022] DELETE /identity/v3/projects/810cd2860c0a4d6c8c9086a70d18ea12 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:25.912920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768007-f5f1-4e6f-99c9-72ca9fc21b37 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:25.913327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768007-f5f1-4e6f-99c9-72ca9fc21b37 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:25.913789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768007-f5f1-4e6f-99c9-72ca9fc21b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:25.943807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-89768007-f5f1-4e6f-99c9-72ca9fc21b37 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:25.945165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-89768007-f5f1-4e6f-99c9-72ca9fc21b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:25.977848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:26.016238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1006/2006] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:26.018849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b2a4-489a-4353-8e81-044107ef44f7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.019200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b2a4-489a-4353-8e81-044107ef44f7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.019923 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b2a4-489a-4353-8e81-044107ef44f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.043548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e8f9b2a4-489a-4353-8e81-044107ef44f7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:26.045054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e8f9b2a4-489a-4353-8e81-044107ef44f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.054000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1001/2007] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:26.058294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768007-f5f1-4e6f-99c9-72ca9fc21b37 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.070802 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768007-f5f1-4e6f-99c9-72ca9fc21b37 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.086061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79825bd1-a6f7-4bb2-bd17-bdcea4cd72fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.088196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79825bd1-a6f7-4bb2-bd17-bdcea4cd72fe admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.088196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79825bd1-a6f7-4bb2-bd17-bdcea4cd72fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.088196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79825bd1-a6f7-4bb2-bd17-bdcea4cd72fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.088196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79825bd1-a6f7-4bb2-bd17-bdcea4cd72fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:26.088196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79825bd1-a6f7-4bb2-bd17-bdcea4cd72fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.090392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79825bd1-a6f7-4bb2-bd17-bdcea4cd72fe admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.091863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9b2a4-489a-4353-8e81-044107ef44f7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.093454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e8f9b2a4-489a-4353-8e81-044107ef44f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.119938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9b2a4-489a-4353-8e81-044107ef44f7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.130326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.131499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.131992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.132510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] PATH_INFO: `/v3/projects/a02a7678dcec432db30e39e73c21de70` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.134836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02a7678dcec432db30e39e73c21de70)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.141695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1007/2008] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:26.141862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.143194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79825bd1-a6f7-4bb2-bd17-bdcea4cd72fe admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.157022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79825bd1-a6f7-4bb2-bd17-bdcea4cd72fe admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.166301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6b752-94bf-4e57-ba4f-bb820084ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.167173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b752-94bf-4e57-ba4f-bb820084ce21 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.167562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b752-94bf-4e57-ba4f-bb820084ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.167958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b752-94bf-4e57-ba4f-bb820084ce21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.168698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6b752-94bf-4e57-ba4f-bb820084ce21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.172989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6b752-94bf-4e57-ba4f-bb820084ce21 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.283092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02a7678dcec432db30e39e73c21de70', 'request_id': 'req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:26.284350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1008/2009] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:26 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:26.289096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6b752-94bf-4e57-ba4f-bb820084ce21 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.295117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02a7678dcec432db30e39e73c21de70', 'request_id': 'req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:26.303150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02a7678dcec432db30e39e73c21de70', 'request_id': 'req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:26.359054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6b752-94bf-4e57-ba4f-bb820084ce21 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.364264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abec1bf-be8c-4c1d-b870-cfe9c695b922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.364877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abec1bf-be8c-4c1d-b870-cfe9c695b922 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.368324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abec1bf-be8c-4c1d-b870-cfe9c695b922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.368324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abec1bf-be8c-4c1d-b870-cfe9c695b922 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.368324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abec1bf-be8c-4c1d-b870-cfe9c695b922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.368815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abec1bf-be8c-4c1d-b870-cfe9c695b922 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.393282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] The token cache is being invalidate because project a02a7678dcec432db30e39e73c21de70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:26.393576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:26.394231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:26.397163 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1002/2010] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:26 2022] DELETE /identity/v3/projects/a02a7678dcec432db30e39e73c21de70 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:26.397163 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.398379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.464618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8d3e-bdec-42c2-a960-e91cdd71b13d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.469824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.470484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.470763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.471155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] PATH_INFO: `/v3/projects/ed19683e72e04a83878ba21470720299` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.472281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed19683e72e04a83878ba21470720299)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.474248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.474704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1009/2011] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:26 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:26.476054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c883cb7-0ed8-4c45-86e5-d78cb5744780 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.476383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c883cb7-0ed8-4c45-86e5-d78cb5744780 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.476687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c883cb7-0ed8-4c45-86e5-d78cb5744780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.499875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5c883cb7-0ed8-4c45-86e5-d78cb5744780 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:26.501590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c883cb7-0ed8-4c45-86e5-d78cb5744780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.511939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1010/2012] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:26.521269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c883cb7-0ed8-4c45-86e5-d78cb5744780 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.522704 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c883cb7-0ed8-4c45-86e5-d78cb5744780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.534949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c883cb7-0ed8-4c45-86e5-d78cb5744780 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.539737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166781bb-6f5c-4581-a845-ecadfbe1dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.540420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166781bb-6f5c-4581-a845-ecadfbe1dcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.540976 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166781bb-6f5c-4581-a845-ecadfbe1dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.541261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166781bb-6f5c-4581-a845-ecadfbe1dcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.542181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166781bb-6f5c-4581-a845-ecadfbe1dcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.544087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166781bb-6f5c-4581-a845-ecadfbe1dcf7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.546411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:26.556238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1011/2013] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:26.557449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f10a-1ec7-4b90-9134-58f307cfd0d5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.557753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f10a-1ec7-4b90-9134-58f307cfd0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.558065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f10a-1ec7-4b90-9134-58f307cfd0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.581224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2845f10a-1ec7-4b90-9134-58f307cfd0d5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:26.582466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2845f10a-1ec7-4b90-9134-58f307cfd0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.592021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1012/2014] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:26.593211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f10a-1ec7-4b90-9134-58f307cfd0d5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.603177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed19683e72e04a83878ba21470720299', 'request_id': 'req-06859ae2-0969-42fa-96c2-6ce2d77658de'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:26.603954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f10a-1ec7-4b90-9134-58f307cfd0d5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.608835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed19683e72e04a83878ba21470720299', 'request_id': 'req-06859ae2-0969-42fa-96c2-6ce2d77658de'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:26.615875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed19683e72e04a83878ba21470720299', 'request_id': 'req-06859ae2-0969-42fa-96c2-6ce2d77658de'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:26.669887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04fd6d-9dac-4fac-b8e2-5877e72a7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.670506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04fd6d-9dac-4fac-b8e2-5877e72a7372 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.670793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04fd6d-9dac-4fac-b8e2-5877e72a7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.671062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04fd6d-9dac-4fac-b8e2-5877e72a7372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.671698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04fd6d-9dac-4fac-b8e2-5877e72a7372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.673447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04fd6d-9dac-4fac-b8e2-5877e72a7372 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.684356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1013/2015] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:26.685214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04fd6d-9dac-4fac-b8e2-5877e72a7372 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.691984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] The token cache is being invalidate because project ed19683e72e04a83878ba21470720299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:26.692288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:26.693436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:26.698055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1003/2016] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:26 2022] DELETE /identity/v3/projects/ed19683e72e04a83878ba21470720299 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:26.698055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.698233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04fd6d-9dac-4fac-b8e2-5877e72a7372 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.699376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.703381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6a97e-0a5c-40b7-9afe-311636a7f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.704046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6a97e-0a5c-40b7-9afe-311636a7f4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.704353 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6a97e-0a5c-40b7-9afe-311636a7f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.704630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6a97e-0a5c-40b7-9afe-311636a7f4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.705282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6a97e-0a5c-40b7-9afe-311636a7f4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:26.705589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6a97e-0a5c-40b7-9afe-311636a7f4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.707236 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6a97e-0a5c-40b7-9afe-311636a7f4b0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.713195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859ae2-0969-42fa-96c2-6ce2d77658de admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.719193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754034c-e348-4d78-8e12-6e085f427906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.720290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754034c-e348-4d78-8e12-6e085f427906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.720420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1014/2017] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:26.720533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754034c-e348-4d78-8e12-6e085f427906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.720611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754034c-e348-4d78-8e12-6e085f427906 admin admin] PATH_INFO: `/v3/projects/c0edb559c2c6493d86e99ee2573d241d/users/e5ae851041b047f4bba91e17a18f6bc0/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.725820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56f650-4243-44d9-a0be-fa524fd8f517 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.726110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56f650-4243-44d9-a0be-fa524fd8f517 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.726387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56f650-4243-44d9-a0be-fa524fd8f517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.738230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754034c-e348-4d78-8e12-6e085f427906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0edb559c2c6493d86e99ee2573d241d, user_id=e5ae851041b047f4bba91e17a18f6bc0, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.741563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754034c-e348-4d78-8e12-6e085f427906 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.748833 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8a56f650-4243-44d9-a0be-fa524fd8f517 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:26.749945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8a56f650-4243-44d9-a0be-fa524fd8f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.758289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1015/2018] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:26.758978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56f650-4243-44d9-a0be-fa524fd8f517 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.760239 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8a56f650-4243-44d9-a0be-fa524fd8f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.771631 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56f650-4243-44d9-a0be-fa524fd8f517 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.778041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a0bb5-5a95-48df-a6f0-c14d45b896b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.778637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0bb5-5a95-48df-a6f0-c14d45b896b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.778917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0bb5-5a95-48df-a6f0-c14d45b896b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.779190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0bb5-5a95-48df-a6f0-c14d45b896b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.779820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a0bb5-5a95-48df-a6f0-c14d45b896b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.781793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a0bb5-5a95-48df-a6f0-c14d45b896b1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.845823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1004/2019] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:26 2022] PUT /identity/v3/projects/c0edb559c2c6493d86e99ee2573d241d/users/e5ae851041b047f4bba91e17a18f6bc0/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:26.847079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af2583-f2b2-4cab-b680-f9f98e215367 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.847374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af2583-f2b2-4cab-b680-f9f98e215367 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.847647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af2583-f2b2-4cab-b680-f9f98e215367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.868442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-32af2583-f2b2-4cab-b680-f9f98e215367 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:26.869649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-32af2583-f2b2-4cab-b680-f9f98e215367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.875563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1016/2020] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:26 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:26.876505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a0bb5-5a95-48df-a6f0-c14d45b896b1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:26.878092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7c6a0bb5-5a95-48df-a6f0-c14d45b896b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:26.934059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1005/2021] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:26.935406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d90d-abe1-40f0-9106-0b83324acb23 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.935692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d90d-abe1-40f0-9106-0b83324acb23 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.936010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d90d-abe1-40f0-9106-0b83324acb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.943009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a0bb5-5a95-48df-a6f0-c14d45b896b1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:26.948863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:26.949505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:26.949774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:26.950048 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] PATH_INFO: `/v3/users/3f1099557a1b48f5b47108406742a0f1` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:26.951203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1099557a1b48f5b47108406742a0f1)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:26.953199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:26.968703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f6f5d90d-abe1-40f0-9106-0b83324acb23 None None] MFA Rules not processed for user `e5ae851041b047f4bba91e17a18f6bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:26.970274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f6f5d90d-abe1-40f0-9106-0b83324acb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:27.035386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1006/2022] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:27.036360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5d90d-abe1-40f0-9106-0b83324acb23 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:27.050153 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5d90d-abe1-40f0-9106-0b83324acb23 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:27.054934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab2b18-6cdf-49f6-85d9-44c08bd34418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:27.055543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab2b18-6cdf-49f6-85d9-44c08bd34418 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.055829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab2b18-6cdf-49f6-85d9-44c08bd34418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.056170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab2b18-6cdf-49f6-85d9-44c08bd34418 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.058927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab2b18-6cdf-49f6-85d9-44c08bd34418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:27.058927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab2b18-6cdf-49f6-85d9-44c08bd34418 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:27.085757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:27.179441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1007/2023] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:27 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:27.179441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab2b18-6cdf-49f6-85d9-44c08bd34418 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:27.187896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab2b18-6cdf-49f6-85d9-44c08bd34418 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:27.192915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157dc1a-3cad-4b88-887a-991af52f15d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:27.193542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157dc1a-3cad-4b88-887a-991af52f15d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.193820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157dc1a-3cad-4b88-887a-991af52f15d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.194091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157dc1a-3cad-4b88-887a-991af52f15d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.194760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157dc1a-3cad-4b88-887a-991af52f15d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:27.195062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157dc1a-3cad-4b88-887a-991af52f15d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:27.195234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1099557a1b48f5b47108406742a0f1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.196694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157dc1a-3cad-4b88-887a-991af52f15d5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:27.209370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1008/2024] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:27.210875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157dc1a-3cad-4b88-887a-991af52f15d5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:27.211944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7157dc1a-3cad-4b88-887a-991af52f15d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:27.266577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157dc1a-3cad-4b88-887a-991af52f15d5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:27.270354 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60e1ac-d8e6-492a-be65-3fc8eacbf686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:27.270947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e1ac-d8e6-492a-be65-3fc8eacbf686 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.271227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e1ac-d8e6-492a-be65-3fc8eacbf686 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.272059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e1ac-d8e6-492a-be65-3fc8eacbf686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.278821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1099557a1b48f5b47108406742a0f1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.280172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e1ac-d8e6-492a-be65-3fc8eacbf686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:27.281601 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e1ac-d8e6-492a-be65-3fc8eacbf686 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:27.286101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1099557a1b48f5b47108406742a0f1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.286757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1099557a1b48f5b47108406742a0f1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.291823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1009/2025] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:27.292668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60e1ac-d8e6-492a-be65-3fc8eacbf686 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:27.293956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5e60e1ac-d8e6-492a-be65-3fc8eacbf686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:27.302360 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1099557a1b48f5b47108406742a0f1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.308322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60e1ac-d8e6-492a-be65-3fc8eacbf686 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:27.313082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1017/2026] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:26 2022] DELETE /identity/v3/users/3f1099557a1b48f5b47108406742a0f1 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:27.313938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:27.315993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:27.359968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:27.365437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:27.366067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.366345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.366640 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] PATH_INFO: `/v3/users/1af2e5d99b9f4db297775ce718e8f574` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.368039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af2e5d99b9f4db297775ce718e8f574)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:27.370065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:27.382428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8246d-70f1-41d4-bb15-cba2a7dd70f8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:27.387250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944c0e1-65e6-40b3-89b7-2cb89166dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:27.392963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c0e1-65e6-40b3-89b7-2cb89166dbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.392963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c0e1-65e6-40b3-89b7-2cb89166dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.392963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c0e1-65e6-40b3-89b7-2cb89166dbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.392963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944c0e1-65e6-40b3-89b7-2cb89166dbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:27.392963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944c0e1-65e6-40b3-89b7-2cb89166dbf1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:27.401487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1018/2027] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:27.402293 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944c0e1-65e6-40b3-89b7-2cb89166dbf1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:27.404242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1944c0e1-65e6-40b3-89b7-2cb89166dbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:27.416272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944c0e1-65e6-40b3-89b7-2cb89166dbf1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:27.420889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c849ec-35ac-4ee0-934d-a87c08ab6bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:27.421457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c849ec-35ac-4ee0-934d-a87c08ab6bee admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.421732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c849ec-35ac-4ee0-934d-a87c08ab6bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.422001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c849ec-35ac-4ee0-934d-a87c08ab6bee admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.422604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c849ec-35ac-4ee0-934d-a87c08ab6bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:27.424507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c849ec-35ac-4ee0-934d-a87c08ab6bee admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:27.525508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1019/2028] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:27 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:27.526347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c849ec-35ac-4ee0-934d-a87c08ab6bee admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:27.527969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e8c849ec-35ac-4ee0-934d-a87c08ab6bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:27.591751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c849ec-35ac-4ee0-934d-a87c08ab6bee admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:27.596400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:27.597020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.597338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.597605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] PATH_INFO: `/v3/users/e5ae851041b047f4bba91e17a18f6bc0` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.598724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ae851041b047f4bba91e17a18f6bc0)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:27.600747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:27.606512 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af2e5d99b9f4db297775ce718e8f574'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.607161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af2e5d99b9f4db297775ce718e8f574'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.619025 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af2e5d99b9f4db297775ce718e8f574'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.626307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af2e5d99b9f4db297775ce718e8f574'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.736376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-879e6fbe-fab1-4c7e-b194-e8310ff37bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af2e5d99b9f4db297775ce718e8f574'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.742793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1010/2029] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:27 2022] DELETE /identity/v3/users/1af2e5d99b9f4db297775ce718e8f574 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:27.744059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598792-3f00-4113-a0ac-66af98b786cf None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.744341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598792-3f00-4113-a0ac-66af98b786cf None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.744611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598792-3f00-4113-a0ac-66af98b786cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.763462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d7598792-3f00-4113-a0ac-66af98b786cf None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:27.764681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d7598792-3f00-4113-a0ac-66af98b786cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:27.827289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1011/2030] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:27.828826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7598792-3f00-4113-a0ac-66af98b786cf None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:27.831195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d7598792-3f00-4113-a0ac-66af98b786cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:27.843443 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7598792-3f00-4113-a0ac-66af98b786cf None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:27.848774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619aacf-1dc1-4a94-b98c-59b9526e72e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:27.851576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619aacf-1dc1-4a94-b98c-59b9526e72e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.851975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619aacf-1dc1-4a94-b98c-59b9526e72e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.852422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619aacf-1dc1-4a94-b98c-59b9526e72e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.853155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619aacf-1dc1-4a94-b98c-59b9526e72e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:27.854979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619aacf-1dc1-4a94-b98c-59b9526e72e9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:27.867817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ae851041b047f4bba91e17a18f6bc0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.868392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1012/2031] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:27.869233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619aacf-1dc1-4a94-b98c-59b9526e72e9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:27.872802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d619aacf-1dc1-4a94-b98c-59b9526e72e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:27.886268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619aacf-1dc1-4a94-b98c-59b9526e72e9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:27.891227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40763787-f91f-44ec-9410-480b369d1c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:27.891833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763787-f91f-44ec-9410-480b369d1c1f admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.892146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763787-f91f-44ec-9410-480b369d1c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.892421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763787-f91f-44ec-9410-480b369d1c1f admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.893049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40763787-f91f-44ec-9410-480b369d1c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:27.895074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40763787-f91f-44ec-9410-480b369d1c1f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:27.959438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ae851041b047f4bba91e17a18f6bc0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.966802 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ae851041b047f4bba91e17a18f6bc0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.967437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ae851041b047f4bba91e17a18f6bc0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.979294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9cf9c69e-10e6-4023-9bf9-d9e08706f11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ae851041b047f4bba91e17a18f6bc0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:27.985150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1020/2032] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:27 2022] DELETE /identity/v3/users/e5ae851041b047f4bba91e17a18f6bc0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:27.986410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3df8-d799-4fb7-bbce-93d5a8a59816 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:27.986903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3df8-d799-4fb7-bbce-93d5a8a59816 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:27.987195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3df8-d799-4fb7-bbce-93d5a8a59816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:27.995255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1013/2033] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:27 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:27.996915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40763787-f91f-44ec-9410-480b369d1c1f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:27.998150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-40763787-f91f-44ec-9410-480b369d1c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:28.008006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-423f3df8-d799-4fb7-bbce-93d5a8a59816 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:28.009219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-423f3df8-d799-4fb7-bbce-93d5a8a59816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:28.061563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40763787-f91f-44ec-9410-480b369d1c1f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.070508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1021/2034] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:28.071343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f3df8-d799-4fb7-bbce-93d5a8a59816 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:28.072879 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-423f3df8-d799-4fb7-bbce-93d5a8a59816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:28.075300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:28.085442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f3df8-d799-4fb7-bbce-93d5a8a59816 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.091772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c99699-e62a-4e03-bcd8-ff2a5ddeba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:28.092493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99699-e62a-4e03-bcd8-ff2a5ddeba63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.092855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99699-e62a-4e03-bcd8-ff2a5ddeba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.093060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99699-e62a-4e03-bcd8-ff2a5ddeba63 admin admin] PATH_INFO: `/v3/projects/aae4e42dab964b538230d7ec306c529c/users/bdfe1101334e4cf8b6f29e56dd4b5898/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.109536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c99699-e62a-4e03-bcd8-ff2a5ddeba63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae4e42dab964b538230d7ec306c529c, user_id=bdfe1101334e4cf8b6f29e56dd4b5898, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:28.114954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c99699-e62a-4e03-bcd8-ff2a5ddeba63 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:28.118745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184ec56-a736-4fa6-8b63-e1384c0abce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:28.119854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184ec56-a736-4fa6-8b63-e1384c0abce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.125070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184ec56-a736-4fa6-8b63-e1384c0abce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.125070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184ec56-a736-4fa6-8b63-e1384c0abce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.125070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7184ec56-a736-4fa6-8b63-e1384c0abce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:28.137210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184ec56-a736-4fa6-8b63-e1384c0abce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:28.138901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184ec56-a736-4fa6-8b63-e1384c0abce5 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:28.151098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1014/2035] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:28.152425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0ea1-f715-4cb7-a3a9-435d692eaed1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.152711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0ea1-f715-4cb7-a3a9-435d692eaed1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.152991 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0ea1-f715-4cb7-a3a9-435d692eaed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.185461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1022/2036] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:28 2022] PUT /identity/v3/projects/aae4e42dab964b538230d7ec306c529c/users/bdfe1101334e4cf8b6f29e56dd4b5898/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:28.186655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c99699-e62a-4e03-bcd8-ff2a5ddeba63 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:28.189268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3c7e0ea1-f715-4cb7-a3a9-435d692eaed1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:28.190771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3c7e0ea1-f715-4cb7-a3a9-435d692eaed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:28.196666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f4c99699-e62a-4e03-bcd8-ff2a5ddeba63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:28.276155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1015/2037] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:28.276155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e0ea1-f715-4cb7-a3a9-435d692eaed1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:28.281862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c99699-e62a-4e03-bcd8-ff2a5ddeba63 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.291783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc48db-5290-44e5-be34-2f9079d1b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:28.292546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc48db-5290-44e5-be34-2f9079d1b568 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.292946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc48db-5290-44e5-be34-2f9079d1b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.293412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc48db-5290-44e5-be34-2f9079d1b568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.294127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc48db-5290-44e5-be34-2f9079d1b568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:28.296263 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc48db-5290-44e5-be34-2f9079d1b568 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:28.299112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:28.308330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1023/2038] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:28.309465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082fc2-c579-45e0-8136-c1a631b3537e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.309750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082fc2-c579-45e0-8136-c1a631b3537e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.310021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082fc2-c579-45e0-8136-c1a631b3537e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.344306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-87082fc2-c579-45e0-8136-c1a631b3537e None None] MFA Rules not processed for user `bdfe1101334e4cf8b6f29e56dd4b5898`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:28.345561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-87082fc2-c579-45e0-8136-c1a631b3537e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:28.345934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e0ea1-f715-4cb7-a3a9-435d692eaed1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.352010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b38bb7-8719-45e3-a57c-e97892066448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:28.352876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b38bb7-8719-45e3-a57c-e97892066448 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.353376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b38bb7-8719-45e3-a57c-e97892066448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.353825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b38bb7-8719-45e3-a57c-e97892066448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.367438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b38bb7-8719-45e3-a57c-e97892066448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:28.369535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b38bb7-8719-45e3-a57c-e97892066448 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:28.385528 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1016/2039] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:28.386694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b38bb7-8719-45e3-a57c-e97892066448 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:28.397453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b38bb7-8719-45e3-a57c-e97892066448 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.402160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaecbe5-6783-42d2-aca2-bd3f4e6c8a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:28.402848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaecbe5-6783-42d2-aca2-bd3f4e6c8a10 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.403141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaecbe5-6783-42d2-aca2-bd3f4e6c8a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.403540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaecbe5-6783-42d2-aca2-bd3f4e6c8a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.415144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaecbe5-6783-42d2-aca2-bd3f4e6c8a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:28.417039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaecbe5-6783-42d2-aca2-bd3f4e6c8a10 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:28.422599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1024/2040] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:28.426282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082fc2-c579-45e0-8136-c1a631b3537e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:28.432586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1017/2041] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:28.432586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaecbe5-6783-42d2-aca2-bd3f4e6c8a10 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:28.440153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082fc2-c579-45e0-8136-c1a631b3537e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.446818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaecbe5-6783-42d2-aca2-bd3f4e6c8a10 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.447561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10f1e4-6608-4045-8187-014cc2663f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:28.448030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10f1e4-6608-4045-8187-014cc2663f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.448543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10f1e4-6608-4045-8187-014cc2663f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.448822 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10f1e4-6608-4045-8187-014cc2663f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.449879 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10f1e4-6608-4045-8187-014cc2663f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:28.452122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10f1e4-6608-4045-8187-014cc2663f5e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:28.466299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f43014-7fd4-4373-9246-ea5f761c7181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:28.466896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1025/2042] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:28.467504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f43014-7fd4-4373-9246-ea5f761c7181 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.467854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f43014-7fd4-4373-9246-ea5f761c7181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.468215 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f43014-7fd4-4373-9246-ea5f761c7181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.468923 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f43014-7fd4-4373-9246-ea5f761c7181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:28.471476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f43014-7fd4-4373-9246-ea5f761c7181 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:28.472321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10f1e4-6608-4045-8187-014cc2663f5e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:28.485161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10f1e4-6608-4045-8187-014cc2663f5e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.491578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772ce3-c4fb-4c6b-a009-373ba8cdf37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:28.493201 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772ce3-c4fb-4c6b-a009-373ba8cdf37b admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.493596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772ce3-c4fb-4c6b-a009-373ba8cdf37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.493974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772ce3-c4fb-4c6b-a009-373ba8cdf37b admin admin] PATH_INFO: `/v3/projects/7da6b851472246f9a3478b1d27ae78e2/users/bf5f25f00f494bb6b77ff4c267f804ec/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.515311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8772ce3-c4fb-4c6b-a009-373ba8cdf37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da6b851472246f9a3478b1d27ae78e2, user_id=bf5f25f00f494bb6b77ff4c267f804ec, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:28.519719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8772ce3-c4fb-4c6b-a009-373ba8cdf37b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:28.600556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1018/2043] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:28 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:28.600856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1026/2044] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:28 2022] PUT /identity/v3/projects/7da6b851472246f9a3478b1d27ae78e2/users/bf5f25f00f494bb6b77ff4c267f804ec/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:28.610788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772ce3-c4fb-4c6b-a009-373ba8cdf37b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:28.611318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d07a3e-fc7a-4545-8a84-2de0f1d13e8a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.611810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d07a3e-fc7a-4545-8a84-2de0f1d13e8a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.611970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d07a3e-fc7a-4545-8a84-2de0f1d13e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.622465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:28.643714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-99d07a3e-fc7a-4545-8a84-2de0f1d13e8a None None] MFA Rules not processed for user `bf5f25f00f494bb6b77ff4c267f804ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:28.645124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-99d07a3e-fc7a-4545-8a84-2de0f1d13e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:28.665408 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:28.688467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772ce3-c4fb-4c6b-a009-373ba8cdf37b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.730582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1019/2045] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:28.731480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d07a3e-fc7a-4545-8a84-2de0f1d13e8a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:28.732833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-99d07a3e-fc7a-4545-8a84-2de0f1d13e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:28.764957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b821d0-995a-436d-98f0-7a0016999c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:28.765639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b821d0-995a-436d-98f0-7a0016999c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.765909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b821d0-995a-436d-98f0-7a0016999c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.766584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b821d0-995a-436d-98f0-7a0016999c36 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.766816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b821d0-995a-436d-98f0-7a0016999c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:28.769222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b821d0-995a-436d-98f0-7a0016999c36 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:28.807531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d07a3e-fc7a-4545-8a84-2de0f1d13e8a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.812303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:28.812947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:28.813223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:28.813491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] PATH_INFO: `/v3/projects/dcba67b46d754ff2aadc47f6be96357b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:28.814738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcba67b46d754ff2aadc47f6be96357b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:28.817350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:28.889262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1027/2046] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:28 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:28.889262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b821d0-995a-436d-98f0-7a0016999c36 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:28.889262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-20b821d0-995a-436d-98f0-7a0016999c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:28.909927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:28.951982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcba67b46d754ff2aadc47f6be96357b', 'request_id': 'req-a84390df-126f-47fd-9ddf-31569e878e86'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:28.961210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcba67b46d754ff2aadc47f6be96357b', 'request_id': 'req-a84390df-126f-47fd-9ddf-31569e878e86'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:28.973644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcba67b46d754ff2aadc47f6be96357b', 'request_id': 'req-a84390df-126f-47fd-9ddf-31569e878e86'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:28.979111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b821d0-995a-436d-98f0-7a0016999c36 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:28.994327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:29.059748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fed67-3d77-44a6-8376-7b0ba4578d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:29.061330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fed67-3d77-44a6-8376-7b0ba4578d18 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:29.061754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fed67-3d77-44a6-8376-7b0ba4578d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:29.062135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fed67-3d77-44a6-8376-7b0ba4578d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:29.082816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] The token cache is being invalidate because project dcba67b46d754ff2aadc47f6be96357b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:29.083279 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.084634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.086893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1020/2047] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:28 2022] DELETE /identity/v3/projects/dcba67b46d754ff2aadc47f6be96357b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:29.092437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:29.094091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:29.187667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84390df-126f-47fd-9ddf-31569e878e86 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:29.188005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fed67-3d77-44a6-8376-7b0ba4578d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:29.191795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fed67-3d77-44a6-8376-7b0ba4578d18 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:29.201875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2f9cb-8c10-4de7-9e75-b8050459072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:29.204159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1028/2048] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:29.205158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fed67-3d77-44a6-8376-7b0ba4578d18 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:29.206432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2f9cb-8c10-4de7-9e75-b8050459072a admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:29.206795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2f9cb-8c10-4de7-9e75-b8050459072a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:29.207072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2f9cb-8c10-4de7-9e75-b8050459072a admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:29.207750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2f9cb-8c10-4de7-9e75-b8050459072a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:29.209694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2f9cb-8c10-4de7-9e75-b8050459072a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:29.217347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fed67-3d77-44a6-8376-7b0ba4578d18 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:29.226846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1021/2049] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:29.226846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2f9cb-8c10-4de7-9e75-b8050459072a admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:29.227934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:29.228076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7eb2f9cb-8c10-4de7-9e75-b8050459072a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:29.228166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:29.228166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:29.228166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] PATH_INFO: `/v3/users/d0949e22a0644bf0b1e27accd3ceebbc` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:29.228166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0949e22a0644bf0b1e27accd3ceebbc)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:29.230014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:29.239014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2f9cb-8c10-4de7-9e75-b8050459072a admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:29.246299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:29.247261 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:29.247598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:29.247950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] PATH_INFO: `/v3/projects/2337852ebdf14b8a872e495d39209a30` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:29.249142 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2337852ebdf14b8a872e495d39209a30)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:29.251250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:29.452788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0949e22a0644bf0b1e27accd3ceebbc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.462981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2337852ebdf14b8a872e495d39209a30', 'request_id': 'req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.475494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2337852ebdf14b8a872e495d39209a30', 'request_id': 'req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.486489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2337852ebdf14b8a872e495d39209a30', 'request_id': 'req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.530982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0949e22a0644bf0b1e27accd3ceebbc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.540427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0949e22a0644bf0b1e27accd3ceebbc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.541173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0949e22a0644bf0b1e27accd3ceebbc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.553104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0949e22a0644bf0b1e27accd3ceebbc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.559911 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1029/2050] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:29 2022] DELETE /identity/v3/users/d0949e22a0644bf0b1e27accd3ceebbc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:29.560574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:29.561897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:29.629207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1fb5f-1617-4f4c-92fb-9039b71f1422 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:29.634681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d7776-f467-49b9-9daf-b78e018bde36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:29.635355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d7776-f467-49b9-9daf-b78e018bde36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:29.635638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d7776-f467-49b9-9daf-b78e018bde36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:29.635952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d7776-f467-49b9-9daf-b78e018bde36 admin admin] PATH_INFO: `/v3/projects/6299b52af1f7407ebe7f8b238e7ad7fd/users/4f71c395a0b047aab3ad824dca20facc/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:29.645245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] The token cache is being invalidate because project 2337852ebdf14b8a872e495d39209a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:29.646025 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.647232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:29.649769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1022/2051] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:29 2022] DELETE /identity/v3/projects/2337852ebdf14b8a872e495d39209a30 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:29.652300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:29.653052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:29.654978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d7776-f467-49b9-9daf-b78e018bde36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6299b52af1f7407ebe7f8b238e7ad7fd, user_id=4f71c395a0b047aab3ad824dca20facc, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:29.658059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d7776-f467-49b9-9daf-b78e018bde36 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:29.695646 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:29.731360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1f557-7dfd-4795-85bd-16a6e8cc7f8b admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:29.737997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1030/2052] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:29 2022] PUT /identity/v3/projects/6299b52af1f7407ebe7f8b238e7ad7fd/users/4f71c395a0b047aab3ad824dca20facc/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:29.739556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d7776-f467-49b9-9daf-b78e018bde36 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:29.743786 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-338d7776-f467-49b9-9daf-b78e018bde36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:29.809580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:29.810296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:29.810573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:29.810842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] PATH_INFO: `/v3/projects/c0edb559c2c6493d86e99ee2573d241d` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:29.812317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0edb559c2c6493d86e99ee2573d241d)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:29.814500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:29.831642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:29.876924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d7776-f467-49b9-9daf-b78e018bde36 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:29.887217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:29.888227 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:29.888627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:29.888899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] PATH_INFO: `/v3/users/ef77059070e04a568f9cb256c9930c5b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:29.890156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef77059070e04a568f9cb256c9930c5b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:29.892796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:30.008196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0edb559c2c6493d86e99ee2573d241d', 'request_id': 'req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.014372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0edb559c2c6493d86e99ee2573d241d', 'request_id': 'req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.021790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0edb559c2c6493d86e99ee2573d241d', 'request_id': 'req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.142696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] The token cache is being invalidate because project c0edb559c2c6493d86e99ee2573d241d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:30.142989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.144454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.146881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1023/2053] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:29 2022] DELETE /identity/v3/projects/c0edb559c2c6493d86e99ee2573d241d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:30.148075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:30.149904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.160986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef77059070e04a568f9cb256c9930c5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.234266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef77059070e04a568f9cb256c9930c5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.242874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef77059070e04a568f9cb256c9930c5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.243762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef77059070e04a568f9cb256c9930c5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.251797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f0b93-9676-40c2-9fb8-2baf0828e88d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:30.256333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9514ecb3-da1d-46c9-948c-3073167cc0d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef77059070e04a568f9cb256c9930c5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.256750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b0e79-58d2-4fab-b9e7-d12c3f81a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:30.257373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b0e79-58d2-4fab-b9e7-d12c3f81a076 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:30.257642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b0e79-58d2-4fab-b9e7-d12c3f81a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:30.257897 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b0e79-58d2-4fab-b9e7-d12c3f81a076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:30.258711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b0e79-58d2-4fab-b9e7-d12c3f81a076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:30.260195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b0e79-58d2-4fab-b9e7-d12c3f81a076 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:30.265031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1031/2054] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:29 2022] DELETE /identity/v3/users/ef77059070e04a568f9cb256c9930c5b => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:30.266337 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78334286-951a-45ed-b31a-ab778b963e99 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:30.270721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78334286-951a-45ed-b31a-ab778b963e99 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:30.270721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78334286-951a-45ed-b31a-ab778b963e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:30.275772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1024/2055] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:30.277306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b0e79-58d2-4fab-b9e7-d12c3f81a076 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:30.279924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7b4b0e79-58d2-4fab-b9e7-d12c3f81a076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.295394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b0e79-58d2-4fab-b9e7-d12c3f81a076 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:30.313615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-78334286-951a-45ed-b31a-ab778b963e99 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:30.317683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-78334286-951a-45ed-b31a-ab778b963e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.368372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:30.369111 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:30.369854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:30.369854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] PATH_INFO: `/v3/projects/ce3c8f98c5774814803c6bd871940c15` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:30.371177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3c8f98c5774814803c6bd871940c15)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:30.373722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:30.416300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1032/2056] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:30.417236 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78334286-951a-45ed-b31a-ab778b963e99 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:30.423684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-78334286-951a-45ed-b31a-ab778b963e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.435691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78334286-951a-45ed-b31a-ab778b963e99 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:30.440445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e1196-5a8a-4ef4-961b-e243ee77e84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:30.441102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e1196-5a8a-4ef4-961b-e243ee77e84d admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:30.441376 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e1196-5a8a-4ef4-961b-e243ee77e84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:30.445320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e1196-5a8a-4ef4-961b-e243ee77e84d admin admin] PATH_INFO: `/v3/projects/6299b52af1f7407ebe7f8b238e7ad7fd/users/4f71c395a0b047aab3ad824dca20facc/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:30.445320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e1196-5a8a-4ef4-961b-e243ee77e84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6299b52af1f7407ebe7f8b238e7ad7fd, user_id=4f71c395a0b047aab3ad824dca20facc, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:30.447564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e1196-5a8a-4ef4-961b-e243ee77e84d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:30.458028 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1033/2057] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:30 2022] PUT /identity/v3/projects/6299b52af1f7407ebe7f8b238e7ad7fd/users/4f71c395a0b047aab3ad824dca20facc/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:30.460056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2951e-ce1d-4bbc-be1d-6ba6636574f7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:30.460201 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2951e-ce1d-4bbc-be1d-6ba6636574f7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:30.460649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2951e-ce1d-4bbc-be1d-6ba6636574f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:30.480732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c3f2951e-ce1d-4bbc-be1d-6ba6636574f7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:30.481942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c3f2951e-ce1d-4bbc-be1d-6ba6636574f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.546851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1034/2058] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:30.548177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1db75-f407-4109-86dd-b55ca4d95748 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:30.548464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1db75-f407-4109-86dd-b55ca4d95748 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:30.548735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1db75-f407-4109-86dd-b55ca4d95748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:30.577119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b2d1db75-f407-4109-86dd-b55ca4d95748 None None] MFA Rules not processed for user `4f71c395a0b047aab3ad824dca20facc`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:30.578325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b2d1db75-f407-4109-86dd-b55ca4d95748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.648191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1035/2059] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:30.649066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1db75-f407-4109-86dd-b55ca4d95748 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:30.668197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1db75-f407-4109-86dd-b55ca4d95748 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:30.679306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3c8f98c5774814803c6bd871940c15', 'request_id': 'req-67fed6eb-8ec7-4e08-a30e-c333275c1481'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.685691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3c8f98c5774814803c6bd871940c15', 'request_id': 'req-67fed6eb-8ec7-4e08-a30e-c333275c1481'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.692604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3c8f98c5774814803c6bd871940c15', 'request_id': 'req-67fed6eb-8ec7-4e08-a30e-c333275c1481'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.742180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4da46-8753-4482-9474-6b78a5d5eb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:30.742834 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4da46-8753-4482-9474-6b78a5d5eb16 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:30.743183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4da46-8753-4482-9474-6b78a5d5eb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:30.743475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4da46-8753-4482-9474-6b78a5d5eb16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:30.744172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4da46-8753-4482-9474-6b78a5d5eb16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:30.744473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4da46-8753-4482-9474-6b78a5d5eb16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:30.746192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4da46-8753-4482-9474-6b78a5d5eb16 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:30.758474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1036/2060] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:30.759301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4da46-8753-4482-9474-6b78a5d5eb16 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:30.761045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0ce4da46-8753-4482-9474-6b78a5d5eb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.771280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] The token cache is being invalidate because project ce3c8f98c5774814803c6bd871940c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:30.776144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.776144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:30.776144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1025/2061] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:30 2022] DELETE /identity/v3/projects/ce3c8f98c5774814803c6bd871940c15 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:30.776144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:30.776545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.794896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fed6eb-8ec7-4e08-a30e-c333275c1481 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:30.803542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821c4e8-948a-4aa9-975f-4b4805fa0f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:30.804200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821c4e8-948a-4aa9-975f-4b4805fa0f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:30.804488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821c4e8-948a-4aa9-975f-4b4805fa0f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:30.804806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821c4e8-948a-4aa9-975f-4b4805fa0f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:30.805526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821c4e8-948a-4aa9-975f-4b4805fa0f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:30.807452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821c4e8-948a-4aa9-975f-4b4805fa0f2d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:30.827830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4da46-8753-4482-9474-6b78a5d5eb16 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:30.834931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c97fa-95cf-4340-9cd1-7bfa3a936bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:30.835556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c97fa-95cf-4340-9cd1-7bfa3a936bac service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:30.835835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c97fa-95cf-4340-9cd1-7bfa3a936bac service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:30.836134 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c97fa-95cf-4340-9cd1-7bfa3a936bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:30.838023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-997c97fa-95cf-4340-9cd1-7bfa3a936bac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.899584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c97fa-95cf-4340-9cd1-7bfa3a936bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:30.901217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c97fa-95cf-4340-9cd1-7bfa3a936bac service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:30.913488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1037/2062] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:30.914360 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c97fa-95cf-4340-9cd1-7bfa3a936bac service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:30.914842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1026/2063] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:30 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:30.915792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821c4e8-948a-4aa9-975f-4b4805fa0f2d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:30.918007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d821c4e8-948a-4aa9-975f-4b4805fa0f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.919611 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-997c97fa-95cf-4340-9cd1-7bfa3a936bac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:30.935599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c97fa-95cf-4340-9cd1-7bfa3a936bac service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:30.982386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:31.009268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:31.009914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.010194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.010469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] PATH_INFO: `/v3/users/f6b6a028d72448bba3ca56f1eb81cd17` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.010872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821c4e8-948a-4aa9-975f-4b4805fa0f2d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:31.012714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b6a028d72448bba3ca56f1eb81cd17)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:31.019181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:31.019287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:31.019287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.019287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.019287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] PATH_INFO: `/v3/projects/6c7954d2e5da413394940383a9e888f5` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.019622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7954d2e5da413394940383a9e888f5)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:31.020271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:31.066768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:31.201886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b6a028d72448bba3ca56f1eb81cd17'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:31.202418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7954d2e5da413394940383a9e888f5', 'request_id': 'req-5403186c-f9c2-4945-9eee-6c0a6994d5e9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:31.208300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7954d2e5da413394940383a9e888f5', 'request_id': 'req-5403186c-f9c2-4945-9eee-6c0a6994d5e9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:31.214762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7954d2e5da413394940383a9e888f5', 'request_id': 'req-5403186c-f9c2-4945-9eee-6c0a6994d5e9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:31.263151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b6a028d72448bba3ca56f1eb81cd17'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:31.270809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b6a028d72448bba3ca56f1eb81cd17'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:31.271487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b6a028d72448bba3ca56f1eb81cd17'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:31.282978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b6a028d72448bba3ca56f1eb81cd17'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:31.289404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1038/2064] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:30 2022] DELETE /identity/v3/users/f6b6a028d72448bba3ca56f1eb81cd17 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:31.290163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:31.291455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:31.358403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8845d5-82e5-4f2a-8b67-262b64ca5017 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:31.363380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290afa2-3928-4ef3-a8b2-1c6a45e6d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:31.364059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290afa2-3928-4ef3-a8b2-1c6a45e6d1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.364337 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290afa2-3928-4ef3-a8b2-1c6a45e6d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.364607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290afa2-3928-4ef3-a8b2-1c6a45e6d1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.366227 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290afa2-3928-4ef3-a8b2-1c6a45e6d1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:31.368603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290afa2-3928-4ef3-a8b2-1c6a45e6d1d4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:31.385755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] The token cache is being invalidate because project 6c7954d2e5da413394940383a9e888f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:31.386054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:31.390307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5403186c-f9c2-4945-9eee-6c0a6994d5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:31.390307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1027/2065] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:30 2022] DELETE /identity/v3/projects/6c7954d2e5da413394940383a9e888f5 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:31.393618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6a94-e6f5-4a33-aec4-82b343eda131 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.393894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6a94-e6f5-4a33-aec4-82b343eda131 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.394843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6a94-e6f5-4a33-aec4-82b343eda131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.416804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7ada6a94-e6f5-4a33-aec4-82b343eda131 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:31.422575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7ada6a94-e6f5-4a33-aec4-82b343eda131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:31.426256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1028/2066] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:31.434588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554ba81-32dc-4362-8feb-5776613f53ba None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.434873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554ba81-32dc-4362-8feb-5776613f53ba None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.435149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554ba81-32dc-4362-8feb-5776613f53ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.456681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5554ba81-32dc-4362-8feb-5776613f53ba None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:31.457897 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5554ba81-32dc-4362-8feb-5776613f53ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:31.466697 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1029/2067] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:31.470441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554ba81-32dc-4362-8feb-5776613f53ba None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:31.482042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554ba81-32dc-4362-8feb-5776613f53ba None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:31.484243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1039/2068] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:31 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:31.487868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290afa2-3928-4ef3-a8b2-1c6a45e6d1d4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:31.489780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2290afa2-3928-4ef3-a8b2-1c6a45e6d1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:31.490920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e30bf7-fd31-42ee-954e-d561c5e04329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:31.491539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e30bf7-fd31-42ee-954e-d561c5e04329 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.492127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e30bf7-fd31-42ee-954e-d561c5e04329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.492404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e30bf7-fd31-42ee-954e-d561c5e04329 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.493484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e30bf7-fd31-42ee-954e-d561c5e04329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:31.493621 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e30bf7-fd31-42ee-954e-d561c5e04329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:31.495758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e30bf7-fd31-42ee-954e-d561c5e04329 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:31.511502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290afa2-3928-4ef3-a8b2-1c6a45e6d1d4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:31.516569 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1030/2069] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:32:31.518230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17bb4e-27e6-47ff-ba0e-d44dc7799973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:31.518899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17bb4e-27e6-47ff-ba0e-d44dc7799973 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.519271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17bb4e-27e6-47ff-ba0e-d44dc7799973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.519773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17bb4e-27e6-47ff-ba0e-d44dc7799973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.520764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e30bf7-fd31-42ee-954e-d561c5e04329 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:31.521901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17bb4e-27e6-47ff-ba0e-d44dc7799973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:31.524334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17bb4e-27e6-47ff-ba0e-d44dc7799973 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:31.552663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e30bf7-fd31-42ee-954e-d561c5e04329 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:31.554479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb692d49-9d47-4e7d-a630-1ba0d5a05f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:31.555253 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb692d49-9d47-4e7d-a630-1ba0d5a05f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.555637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb692d49-9d47-4e7d-a630-1ba0d5a05f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.556057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb692d49-9d47-4e7d-a630-1ba0d5a05f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.556831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb692d49-9d47-4e7d-a630-1ba0d5a05f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:31.558981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb692d49-9d47-4e7d-a630-1ba0d5a05f26 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:31.570613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1040/2070] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:31.578279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17bb4e-27e6-47ff-ba0e-d44dc7799973 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:31.589497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:31.590445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17bb4e-27e6-47ff-ba0e-d44dc7799973 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:31.595524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc1c2b-3bc3-4075-bbfa-a07315ff6ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:31.596409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc1c2b-3bc3-4075-bbfa-a07315ff6ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.596809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc1c2b-3bc3-4075-bbfa-a07315ff6ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.597213 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc1c2b-3bc3-4075-bbfa-a07315ff6ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.597916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc1c2b-3bc3-4075-bbfa-a07315ff6ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:31.600206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc1c2b-3bc3-4075-bbfa-a07315ff6ffa admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:31.612373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1041/2071] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:31.617713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc1c2b-3bc3-4075-bbfa-a07315ff6ffa admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:31.641418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc1c2b-3bc3-4075-bbfa-a07315ff6ffa admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:31.653770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ce58f-921e-4a76-af76-b1c74b8633a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:31.654525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce58f-921e-4a76-af76-b1c74b8633a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.655406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce58f-921e-4a76-af76-b1c74b8633a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.655709 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce58f-921e-4a76-af76-b1c74b8633a9 admin admin] PATH_INFO: `/v3/projects/d1239d8ae3584e098b25a5314ee6a0e0/users/6a5d8a11dbfb4ea5bf0f4671b6fa496f/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.700309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1031/2072] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:31 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:31.703318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb692d49-9d47-4e7d-a630-1ba0d5a05f26 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:31.708677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ce58f-921e-4a76-af76-b1c74b8633a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1239d8ae3584e098b25a5314ee6a0e0, user_id=6a5d8a11dbfb4ea5bf0f4671b6fa496f, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:31.721516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ce58f-921e-4a76-af76-b1c74b8633a9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:31.791176 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb692d49-9d47-4e7d-a630-1ba0d5a05f26 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:31.792848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:31.807735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1042/2073] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:31 2022] PUT /identity/v3/projects/d1239d8ae3584e098b25a5314ee6a0e0/users/6a5d8a11dbfb4ea5bf0f4671b6fa496f/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:31.810903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ce58f-921e-4a76-af76-b1c74b8633a9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:31.817133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a17ce58f-921e-4a76-af76-b1c74b8633a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:31.889251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67fc89-9121-4c4a-930b-5c4e3bd100d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:31.889886 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67fc89-9121-4c4a-930b-5c4e3bd100d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.895912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67fc89-9121-4c4a-930b-5c4e3bd100d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.895912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67fc89-9121-4c4a-930b-5c4e3bd100d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.895912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67fc89-9121-4c4a-930b-5c4e3bd100d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:31.895912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67fc89-9121-4c4a-930b-5c4e3bd100d8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:31.936994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ce58f-921e-4a76-af76-b1c74b8633a9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:31.942237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:31.942922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:31.943835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:31.944142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] PATH_INFO: `/v3/projects/96b4ae92c36942cb93397f01a6ba7bf9` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:31.945343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b4ae92c36942cb93397f01a6ba7bf9)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:31.952994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.005016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1032/2074] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:31 2022] POST /identity/v3/users => generated 281 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:32.006771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073cdf8-f3e6-44f8-9553-22d1e82bcd6b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.007052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073cdf8-f3e6-44f8-9553-22d1e82bcd6b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.007325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073cdf8-f3e6-44f8-9553-22d1e82bcd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.034789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8073cdf8-f3e6-44f8-9553-22d1e82bcd6b None None] MFA Rules not processed for user `6a5d8a11dbfb4ea5bf0f4671b6fa496f`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:32.036039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8073cdf8-f3e6-44f8-9553-22d1e82bcd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:32.093007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b4ae92c36942cb93397f01a6ba7bf9', 'request_id': 'req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:32.098677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b4ae92c36942cb93397f01a6ba7bf9', 'request_id': 'req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:32.103550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1033/2075] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:32.104429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073cdf8-f3e6-44f8-9553-22d1e82bcd6b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.105092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b4ae92c36942cb93397f01a6ba7bf9', 'request_id': 'req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:32.114309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073cdf8-f3e6-44f8-9553-22d1e82bcd6b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.141557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:32.171046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0514939-bf4e-4059-8dfe-2386094eba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.171643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0514939-bf4e-4059-8dfe-2386094eba85 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.171946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0514939-bf4e-4059-8dfe-2386094eba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.172214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0514939-bf4e-4059-8dfe-2386094eba85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.172846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0514939-bf4e-4059-8dfe-2386094eba85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.174427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0514939-bf4e-4059-8dfe-2386094eba85 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.183877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1034/2076] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:32.186913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0514939-bf4e-4059-8dfe-2386094eba85 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.194411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0514939-bf4e-4059-8dfe-2386094eba85 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.199124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd03fbc-b3c5-4bf0-bedc-737bdc0e9452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.199663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd03fbc-b3c5-4bf0-bedc-737bdc0e9452 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.199973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd03fbc-b3c5-4bf0-bedc-737bdc0e9452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.200254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd03fbc-b3c5-4bf0-bedc-737bdc0e9452 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.200840 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd03fbc-b3c5-4bf0-bedc-737bdc0e9452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.202652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd03fbc-b3c5-4bf0-bedc-737bdc0e9452 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.232163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] The token cache is being invalidate because project 96b4ae92c36942cb93397f01a6ba7bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:32.232471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:32.233147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:32.234658 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1043/2077] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:31 2022] DELETE /identity/v3/projects/96b4ae92c36942cb93397f01a6ba7bf9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:32.235426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.236803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:32.249520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa11cf-f81d-4ad5-99ce-2dd01ecf9f8e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.254432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53960e34-bf02-42ca-a0a5-6561416bf78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.255138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960e34-bf02-42ca-a0a5-6561416bf78d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.255365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960e34-bf02-42ca-a0a5-6561416bf78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.256160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960e34-bf02-42ca-a0a5-6561416bf78d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.256789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53960e34-bf02-42ca-a0a5-6561416bf78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.258364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53960e34-bf02-42ca-a0a5-6561416bf78d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.268266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1044/2078] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:32.269413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f30f2b-99a5-4517-acc4-d361ecf9c0ab None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.269781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f30f2b-99a5-4517-acc4-d361ecf9c0ab None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.270055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f30f2b-99a5-4517-acc4-d361ecf9c0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.289741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-26f30f2b-99a5-4517-acc4-d361ecf9c0ab None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:32.290926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-26f30f2b-99a5-4517-acc4-d361ecf9c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:32.291530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1035/2079] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:32 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:32.292386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd03fbc-b3c5-4bf0-bedc-737bdc0e9452 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.350571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1045/2080] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:32.351502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f30f2b-99a5-4517-acc4-d361ecf9c0ab None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.353443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-26f30f2b-99a5-4517-acc4-d361ecf9c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:32.356267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd03fbc-b3c5-4bf0-bedc-737bdc0e9452 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.361158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdb3a2-7bf3-4514-8789-d82ce77211c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.361823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdb3a2-7bf3-4514-8789-d82ce77211c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.362165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdb3a2-7bf3-4514-8789-d82ce77211c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.362433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdb3a2-7bf3-4514-8789-d82ce77211c6 admin admin] PATH_INFO: `/v3/projects/e308609ccf1d4270a33cce4b87afaacf/users/98237136d0d64edf833a3057d336a882/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.365905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f30f2b-99a5-4517-acc4-d361ecf9c0ab None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.371559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b4431-658a-49a8-a1e0-13be2519d0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.372193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b4431-658a-49a8-a1e0-13be2519d0bd admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.372471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b4431-658a-49a8-a1e0-13be2519d0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.372742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b4431-658a-49a8-a1e0-13be2519d0bd admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.373368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b4431-658a-49a8-a1e0-13be2519d0bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.375412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b4431-658a-49a8-a1e0-13be2519d0bd admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.378162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdb3a2-7bf3-4514-8789-d82ce77211c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e308609ccf1d4270a33cce4b87afaacf, user_id=98237136d0d64edf833a3057d336a882, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.381564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdb3a2-7bf3-4514-8789-d82ce77211c6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.472558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1036/2081] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:32 2022] PUT /identity/v3/projects/e308609ccf1d4270a33cce4b87afaacf/users/98237136d0d64edf833a3057d336a882/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:32.473588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc2a83-d252-4c1e-a7f4-cf1d588aca16 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.473865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc2a83-d252-4c1e-a7f4-cf1d588aca16 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.474268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc2a83-d252-4c1e-a7f4-cf1d588aca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.495576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1046/2082] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:32 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:32.495576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddd9a1-00dd-4555-8396-987cd4248b3a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.495576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddd9a1-00dd-4555-8396-987cd4248b3a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.495576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddd9a1-00dd-4555-8396-987cd4248b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.496076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e9dc2a83-d252-4c1e-a7f4-cf1d588aca16 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:32.496982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e9dc2a83-d252-4c1e-a7f4-cf1d588aca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:32.524161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-02ddd9a1-00dd-4555-8396-987cd4248b3a None None] MFA Rules not processed for user `98237136d0d64edf833a3057d336a882`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:32.525406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-02ddd9a1-00dd-4555-8396-987cd4248b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:32.558128 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1037/2083] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:32.559048 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc2a83-d252-4c1e-a7f4-cf1d588aca16 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.570069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc2a83-d252-4c1e-a7f4-cf1d588aca16 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.575033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ff88d-d5bf-4526-9845-41b5adf65cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.575647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff88d-d5bf-4526-9845-41b5adf65cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.575951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff88d-d5bf-4526-9845-41b5adf65cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.576224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff88d-d5bf-4526-9845-41b5adf65cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.576858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ff88d-d5bf-4526-9845-41b5adf65cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.578452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ff88d-d5bf-4526-9845-41b5adf65cdf admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.589078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1038/2084] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:32.589978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ff88d-d5bf-4526-9845-41b5adf65cdf admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.597435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1047/2085] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:32.598274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddd9a1-00dd-4555-8396-987cd4248b3a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.629018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ff88d-d5bf-4526-9845-41b5adf65cdf admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.629350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddd9a1-00dd-4555-8396-987cd4248b3a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.629812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dd837-14a6-4054-9e56-71e9540a0647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.629812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd837-14a6-4054-9e56-71e9540a0647 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.629812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd837-14a6-4054-9e56-71e9540a0647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.630154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf4174-0542-4655-acfd-1ce7249432fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.630154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf4174-0542-4655-acfd-1ce7249432fc admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.630154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf4174-0542-4655-acfd-1ce7249432fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.630154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf4174-0542-4655-acfd-1ce7249432fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.630418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd837-14a6-4054-9e56-71e9540a0647 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.630495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf4174-0542-4655-acfd-1ce7249432fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.630696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dd837-14a6-4054-9e56-71e9540a0647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:32.630696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dd837-14a6-4054-9e56-71e9540a0647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.631970 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf4174-0542-4655-acfd-1ce7249432fc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.632059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dd837-14a6-4054-9e56-71e9540a0647 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.643375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1039/2086] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:32.644467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dd837-14a6-4054-9e56-71e9540a0647 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.646014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1048/2087] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:32.646821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7a9dd837-14a6-4054-9e56-71e9540a0647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:32.662917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf4174-0542-4655-acfd-1ce7249432fc admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.674701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf4174-0542-4655-acfd-1ce7249432fc admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.680942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a3945-a835-4be6-8ca2-0e76eb94946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.681601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a3945-a835-4be6-8ca2-0e76eb94946a admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.681878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a3945-a835-4be6-8ca2-0e76eb94946a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.682286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a3945-a835-4be6-8ca2-0e76eb94946a admin admin] PATH_INFO: `/v3/projects/e94fe95d7bcc4f37997b17f1ee0c8d5f/users/40a9e5ae226544638a1cf19e935a4274/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.698817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a3945-a835-4be6-8ca2-0e76eb94946a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94fe95d7bcc4f37997b17f1ee0c8d5f, user_id=40a9e5ae226544638a1cf19e935a4274, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.701650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a3945-a835-4be6-8ca2-0e76eb94946a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.716900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dd837-14a6-4054-9e56-71e9540a0647 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.716900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa118a7-24a4-4202-b5b2-6eb2dbbc3495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.716900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa118a7-24a4-4202-b5b2-6eb2dbbc3495 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.716900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa118a7-24a4-4202-b5b2-6eb2dbbc3495 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.717650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa118a7-24a4-4202-b5b2-6eb2dbbc3495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.726516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa118a7-24a4-4202-b5b2-6eb2dbbc3495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.727984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa118a7-24a4-4202-b5b2-6eb2dbbc3495 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.737560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1040/2088] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:32.738238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa118a7-24a4-4202-b5b2-6eb2dbbc3495 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.751511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa118a7-24a4-4202-b5b2-6eb2dbbc3495 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.762183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687ebba-9c5a-42e3-8041-9461673a479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.762183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687ebba-9c5a-42e3-8041-9461673a479d admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.762183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687ebba-9c5a-42e3-8041-9461673a479d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.762183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687ebba-9c5a-42e3-8041-9461673a479d admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.762577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687ebba-9c5a-42e3-8041-9461673a479d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.764365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687ebba-9c5a-42e3-8041-9461673a479d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:32.815348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1049/2089] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:32 2022] PUT /identity/v3/projects/e94fe95d7bcc4f37997b17f1ee0c8d5f/users/40a9e5ae226544638a1cf19e935a4274/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:32.816265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a3945-a835-4be6-8ca2-0e76eb94946a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:32.891837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1041/2090] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:32 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:32.899626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412fa5d-595a-4642-82ec-eca9a58591dc None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.899626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412fa5d-595a-4642-82ec-eca9a58591dc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.899626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412fa5d-595a-4642-82ec-eca9a58591dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.901229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a3945-a835-4be6-8ca2-0e76eb94946a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:32.933435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e412fa5d-595a-4642-82ec-eca9a58591dc None None] MFA Rules not processed for user `40a9e5ae226544638a1cf19e935a4274`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:32.934707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e412fa5d-595a-4642-82ec-eca9a58591dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:32.969872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:32.970505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:32.970784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:32.971056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] PATH_INFO: `/v3/users/98237136d0d64edf833a3057d336a882` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:32.972315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98237136d0d64edf833a3057d336a882)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:32.974422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.015539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1042/2091] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:33.015539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412fa5d-595a-4642-82ec-eca9a58591dc None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.025690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412fa5d-595a-4642-82ec-eca9a58591dc None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.030689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99d5f-625c-4bf3-95ed-85592e8570c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.031361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99d5f-625c-4bf3-95ed-85592e8570c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.031797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99d5f-625c-4bf3-95ed-85592e8570c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.032168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99d5f-625c-4bf3-95ed-85592e8570c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.032888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a99d5f-625c-4bf3-95ed-85592e8570c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.034959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a99d5f-625c-4bf3-95ed-85592e8570c7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.233193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1043/2092] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:33 2022] POST /identity/v3/users => generated 301 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:33.234050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99d5f-625c-4bf3-95ed-85592e8570c7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.248024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99d5f-625c-4bf3-95ed-85592e8570c7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.254661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98237136d0d64edf833a3057d336a882'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:33.256525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5dd59-597c-412c-8d15-17228aa81ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.257253 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5dd59-597c-412c-8d15-17228aa81ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.257782 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5dd59-597c-412c-8d15-17228aa81ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.258151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5dd59-597c-412c-8d15-17228aa81ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.258989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5dd59-597c-412c-8d15-17228aa81ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.261378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5dd59-597c-412c-8d15-17228aa81ba6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.313665 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98237136d0d64edf833a3057d336a882'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:33.321910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98237136d0d64edf833a3057d336a882'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:33.322553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98237136d0d64edf833a3057d336a882'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:33.334295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98237136d0d64edf833a3057d336a882'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:33.340367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1050/2093] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:32 2022] DELETE /identity/v3/users/98237136d0d64edf833a3057d336a882 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:33.341146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.342482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:33.371586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1044/2094] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:33 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:33.371586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861f18a-f95d-43c9-af8d-194d92f50f68 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.371586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861f18a-f95d-43c9-af8d-194d92f50f68 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.371586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861f18a-f95d-43c9-af8d-194d92f50f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.399833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b861f18a-f95d-43c9-af8d-194d92f50f68 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:33.401073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b861f18a-f95d-43c9-af8d-194d92f50f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:33.409881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ef1e5-b8ea-4340-9985-57bae8e76c1d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.472350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4580-d077-4902-9f66-ed4c03e64dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.472899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4580-d077-4902-9f66-ed4c03e64dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.473178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4580-d077-4902-9f66-ed4c03e64dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.473452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4580-d077-4902-9f66-ed4c03e64dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.473951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1045/2095] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:33.474096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4580-d077-4902-9f66-ed4c03e64dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.475145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861f18a-f95d-43c9-af8d-194d92f50f68 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.476444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b861f18a-f95d-43c9-af8d-194d92f50f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:33.476698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4580-d077-4902-9f66-ed4c03e64dc4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.488153 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861f18a-f95d-43c9-af8d-194d92f50f68 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.488617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1051/2096] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:33.489638 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4580-d077-4902-9f66-ed4c03e64dc4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.492294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-425c4580-d077-4902-9f66-ed4c03e64dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:33.494061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb61c4-f82a-4a9b-863e-eb6545872685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.494662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb61c4-f82a-4a9b-863e-eb6545872685 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.494937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb61c4-f82a-4a9b-863e-eb6545872685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.495206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb61c4-f82a-4a9b-863e-eb6545872685 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.499071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb61c4-f82a-4a9b-863e-eb6545872685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.499071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb61c4-f82a-4a9b-863e-eb6545872685 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.546591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:33.549632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4580-d077-4902-9f66-ed4c03e64dc4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.553979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb906963-77a3-460f-8343-ff4405af51c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.556492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb906963-77a3-460f-8343-ff4405af51c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.556492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb906963-77a3-460f-8343-ff4405af51c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.556492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb906963-77a3-460f-8343-ff4405af51c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.563723 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb906963-77a3-460f-8343-ff4405af51c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.565171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb906963-77a3-460f-8343-ff4405af51c6 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.574864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1052/2097] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:33.575655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb906963-77a3-460f-8343-ff4405af51c6 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.584508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb906963-77a3-460f-8343-ff4405af51c6 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.585699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1046/2098] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:33 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:33.592208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb61c4-f82a-4a9b-863e-eb6545872685 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.592541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec831ec-0cc1-4a5e-8eda-c4b32d851be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.593145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec831ec-0cc1-4a5e-8eda-c4b32d851be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.593418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec831ec-0cc1-4a5e-8eda-c4b32d851be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.593858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec831ec-0cc1-4a5e-8eda-c4b32d851be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.594500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec831ec-0cc1-4a5e-8eda-c4b32d851be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.596015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec831ec-0cc1-4a5e-8eda-c4b32d851be2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.610919 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1053/2099] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:33.611119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb61c4-f82a-4a9b-863e-eb6545872685 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.612131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec831ec-0cc1-4a5e-8eda-c4b32d851be2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.617829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc803d18-6ba8-468c-abef-75a984dfe8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.618454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc803d18-6ba8-468c-abef-75a984dfe8db admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.618731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc803d18-6ba8-468c-abef-75a984dfe8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.619032 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc803d18-6ba8-468c-abef-75a984dfe8db admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.619691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc803d18-6ba8-468c-abef-75a984dfe8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.621420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc803d18-6ba8-468c-abef-75a984dfe8db admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.625849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec831ec-0cc1-4a5e-8eda-c4b32d851be2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.631073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c91764-26b4-4e79-85ee-4f020169613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.632029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c91764-26b4-4e79-85ee-4f020169613e admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.632632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1047/2100] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:33.635436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c91764-26b4-4e79-85ee-4f020169613e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.635776 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c91764-26b4-4e79-85ee-4f020169613e admin admin] PATH_INFO: `/v3/projects/ce0abbc5d60d48ff91da7ee4858a28e2/users/8eeea64b71204f268c9cbe8118ccb845/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.636474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc803d18-6ba8-468c-abef-75a984dfe8db admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.647070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc803d18-6ba8-468c-abef-75a984dfe8db admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.652050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec505c-1a24-41f1-8f2a-d292d66ddf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.652733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec505c-1a24-41f1-8f2a-d292d66ddf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.653015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec505c-1a24-41f1-8f2a-d292d66ddf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.653458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec505c-1a24-41f1-8f2a-d292d66ddf9a admin admin] PATH_INFO: `/v3/projects/90e9f787ae214541bdc3b00b89a95d49/users/b9670322e9b747048bdfc28ea43ed996/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.653806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c91764-26b4-4e79-85ee-4f020169613e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0abbc5d60d48ff91da7ee4858a28e2, user_id=8eeea64b71204f268c9cbe8118ccb845, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.657509 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c91764-26b4-4e79-85ee-4f020169613e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.670689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec505c-1a24-41f1-8f2a-d292d66ddf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e9f787ae214541bdc3b00b89a95d49, user_id=b9670322e9b747048bdfc28ea43ed996, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.673518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec505c-1a24-41f1-8f2a-d292d66ddf9a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.744127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1054/2101] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:33 2022] PUT /identity/v3/projects/ce0abbc5d60d48ff91da7ee4858a28e2/users/8eeea64b71204f268c9cbe8118ccb845/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:33.756853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f0c7a-7c0d-4540-a6cd-7e35a1218fa0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.757139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f0c7a-7c0d-4540-a6cd-7e35a1218fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.757431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f0c7a-7c0d-4540-a6cd-7e35a1218fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.770413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1048/2102] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:33 2022] PUT /identity/v3/projects/90e9f787ae214541bdc3b00b89a95d49/users/b9670322e9b747048bdfc28ea43ed996/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:33.775824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec505c-1a24-41f1-8f2a-d292d66ddf9a admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.788209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-fd1f0c7a-7c0d-4540-a6cd-7e35a1218fa0 None None] MFA Rules not processed for user `8eeea64b71204f268c9cbe8118ccb845`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:33.789523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fd1f0c7a-7c0d-4540-a6cd-7e35a1218fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:33.834740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:33.851338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec505c-1a24-41f1-8f2a-d292d66ddf9a admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.858896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb09a4b-e46c-4cdb-8d53-38ae4caa9d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.859716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb09a4b-e46c-4cdb-8d53-38ae4caa9d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.860021 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb09a4b-e46c-4cdb-8d53-38ae4caa9d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.860297 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb09a4b-e46c-4cdb-8d53-38ae4caa9d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.861034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb09a4b-e46c-4cdb-8d53-38ae4caa9d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.862779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb09a4b-e46c-4cdb-8d53-38ae4caa9d41 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.879913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1049/2103] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:33.880957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb09a4b-e46c-4cdb-8d53-38ae4caa9d41 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.885046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1055/2104] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:33 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:33.886443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f0c7a-7c0d-4540-a6cd-7e35a1218fa0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:33.894600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb09a4b-e46c-4cdb-8d53-38ae4caa9d41 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.907854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aada655-69dd-48a2-a031-607b105f457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.908572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aada655-69dd-48a2-a031-607b105f457d admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.908847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aada655-69dd-48a2-a031-607b105f457d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.909121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aada655-69dd-48a2-a031-607b105f457d admin admin] PATH_INFO: `/v3/projects/90e9f787ae214541bdc3b00b89a95d49/users/b9670322e9b747048bdfc28ea43ed996/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.911702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aada655-69dd-48a2-a031-607b105f457d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e9f787ae214541bdc3b00b89a95d49, user_id=b9670322e9b747048bdfc28ea43ed996, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.915255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aada655-69dd-48a2-a031-607b105f457d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.916121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f0c7a-7c0d-4540-a6cd-7e35a1218fa0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:33.923957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3040cc7-4b5a-4210-af8d-3de9ed74722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:33.924859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040cc7-4b5a-4210-af8d-3de9ed74722d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.925199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040cc7-4b5a-4210-af8d-3de9ed74722d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.925541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040cc7-4b5a-4210-af8d-3de9ed74722d admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.927084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3040cc7-4b5a-4210-af8d-3de9ed74722d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:33.929130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1050/2105] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:33 2022] PUT /identity/v3/projects/90e9f787ae214541bdc3b00b89a95d49/users/b9670322e9b747048bdfc28ea43ed996/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:33.929424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3040cc7-4b5a-4210-af8d-3de9ed74722d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:33.942831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1a3c-7362-46fa-b59c-2cd739725de1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:33.943073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1a3c-7362-46fa-b59c-2cd739725de1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:33.943422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1a3c-7362-46fa-b59c-2cd739725de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:33.980480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b64c1a3c-7362-46fa-b59c-2cd739725de1 None None] MFA Rules not processed for user `b9670322e9b747048bdfc28ea43ed996`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:33.981921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b64c1a3c-7362-46fa-b59c-2cd739725de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:34.034957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1056/2106] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:33 2022] POST /identity/v3/projects => generated 399 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:34.039155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3040cc7-4b5a-4210-af8d-3de9ed74722d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:34.060540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1051/2107] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:34.097837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1a3c-7362-46fa-b59c-2cd739725de1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:34.100068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b64c1a3c-7362-46fa-b59c-2cd739725de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:34.115571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3040cc7-4b5a-4210-af8d-3de9ed74722d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:34.121803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7090ec-3340-4a39-aa99-591c667ed5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:34.122659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7090ec-3340-4a39-aa99-591c667ed5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.123039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7090ec-3340-4a39-aa99-591c667ed5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.123377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7090ec-3340-4a39-aa99-591c667ed5f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.124372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7090ec-3340-4a39-aa99-591c667ed5f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:34.126363 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7090ec-3340-4a39-aa99-591c667ed5f6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:34.164230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1a3c-7362-46fa-b59c-2cd739725de1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:34.213097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593314b-ab8f-4375-9777-cb17e34884c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:34.213699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593314b-ab8f-4375-9777-cb17e34884c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.214004 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593314b-ab8f-4375-9777-cb17e34884c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.214272 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593314b-ab8f-4375-9777-cb17e34884c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.216153 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d593314b-ab8f-4375-9777-cb17e34884c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:34.232983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1057/2108] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:34 2022] POST /identity/v3/users => generated 306 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:34.234297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7090ec-3340-4a39-aa99-591c667ed5f6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:34.247565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7090ec-3340-4a39-aa99-591c667ed5f6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:34.261085 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd9c8b-52fc-49d6-b1d0-f65c47818937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:34.269622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd9c8b-52fc-49d6-b1d0-f65c47818937 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.269622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd9c8b-52fc-49d6-b1d0-f65c47818937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.269622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd9c8b-52fc-49d6-b1d0-f65c47818937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.269622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd9c8b-52fc-49d6-b1d0-f65c47818937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:34.269622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd9c8b-52fc-49d6-b1d0-f65c47818937 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:34.283710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1058/2109] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:34.285057 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd9c8b-52fc-49d6-b1d0-f65c47818937 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:34.287114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593314b-ab8f-4375-9777-cb17e34884c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:34.288876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593314b-ab8f-4375-9777-cb17e34884c8 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:34.300040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1052/2110] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:34.313267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593314b-ab8f-4375-9777-cb17e34884c8 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:34.314974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d593314b-ab8f-4375-9777-cb17e34884c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:34.327296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd9c8b-52fc-49d6-b1d0-f65c47818937 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:34.343149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593314b-ab8f-4375-9777-cb17e34884c8 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:34.353680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:34.353680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.353680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.353680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] PATH_INFO: `/v3/projects/e308609ccf1d4270a33cce4b87afaacf` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.354366 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e308609ccf1d4270a33cce4b87afaacf)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:34.358452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:34.367282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d5729-0f02-4acb-a4a5-5fb7d42daaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:34.371996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5729-0f02-4acb-a4a5-5fb7d42daaaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.372279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5729-0f02-4acb-a4a5-5fb7d42daaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.372554 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5729-0f02-4acb-a4a5-5fb7d42daaaf admin admin] PATH_INFO: `/v3/projects/07c247241a59497cad7f332a53098968/users/aecc60e726324c91b17abc7226aa0153/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.403680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d5729-0f02-4acb-a4a5-5fb7d42daaaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c247241a59497cad7f332a53098968, user_id=aecc60e726324c91b17abc7226aa0153, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:34.406971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d5729-0f02-4acb-a4a5-5fb7d42daaaf admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:34.538152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1059/2111] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:34 2022] PUT /identity/v3/projects/07c247241a59497cad7f332a53098968/users/aecc60e726324c91b17abc7226aa0153/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:34.542009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d5729-0f02-4acb-a4a5-5fb7d42daaaf admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:34.548259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e308609ccf1d4270a33cce4b87afaacf', 'request_id': 'req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:34.554439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e308609ccf1d4270a33cce4b87afaacf', 'request_id': 'req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:34.560745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e308609ccf1d4270a33cce4b87afaacf', 'request_id': 'req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:34.605059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d5729-0f02-4acb-a4a5-5fb7d42daaaf admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:34.667226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4d19c-b566-4bd1-9a15-e367b05936bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:34.671925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4d19c-b566-4bd1-9a15-e367b05936bc admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.671925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4d19c-b566-4bd1-9a15-e367b05936bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.671925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4d19c-b566-4bd1-9a15-e367b05936bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.671925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4d19c-b566-4bd1-9a15-e367b05936bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:34.672347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] The token cache is being invalidate because project e308609ccf1d4270a33cce4b87afaacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:34.672427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4d19c-b566-4bd1-9a15-e367b05936bc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:34.672497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:34.672497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a80b82bc-3f8a-4600-a9b7-d2135f08a4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:34.674584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1053/2112] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:34 2022] DELETE /identity/v3/projects/e308609ccf1d4270a33cce4b87afaacf => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:34.680043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94b1f1-cc39-4976-8fe3-68bc95fa2a42 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.680854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94b1f1-cc39-4976-8fe3-68bc95fa2a42 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.681304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94b1f1-cc39-4976-8fe3-68bc95fa2a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.684482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1060/2113] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:34.685933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4d19c-b566-4bd1-9a15-e367b05936bc admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:34.687843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b6b4d19c-b566-4bd1-9a15-e367b05936bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:34.702528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4d19c-b566-4bd1-9a15-e367b05936bc admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:34.707710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2a7d5-2c27-4ea9-a92b-9cd4b2395d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:34.708437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2a7d5-2c27-4ea9-a92b-9cd4b2395d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.709329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2a7d5-2c27-4ea9-a92b-9cd4b2395d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.709538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2a7d5-2c27-4ea9-a92b-9cd4b2395d18 admin admin] PATH_INFO: `/v3/projects/07c247241a59497cad7f332a53098968/users/aecc60e726324c91b17abc7226aa0153/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.711377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-dd94b1f1-cc39-4976-8fe3-68bc95fa2a42 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:34.711492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2a7d5-2c27-4ea9-a92b-9cd4b2395d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c247241a59497cad7f332a53098968, user_id=aecc60e726324c91b17abc7226aa0153, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:34.713045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-dd94b1f1-cc39-4976-8fe3-68bc95fa2a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:34.714897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2a7d5-2c27-4ea9-a92b-9cd4b2395d18 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:34.723651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1054/2114] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:34.727175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1061/2115] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:34 2022] PUT /identity/v3/projects/07c247241a59497cad7f332a53098968/users/aecc60e726324c91b17abc7226aa0153/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:34.731765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189d7ec-eb7b-41a7-b29a-c00fab82558a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.732198 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189d7ec-eb7b-41a7-b29a-c00fab82558a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.732594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189d7ec-eb7b-41a7-b29a-c00fab82558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.738709 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea1f19-e096-4a78-b31e-55e4acfbfecf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.743649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea1f19-e096-4a78-b31e-55e4acfbfecf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.743649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea1f19-e096-4a78-b31e-55e4acfbfecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.756052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e189d7ec-eb7b-41a7-b29a-c00fab82558a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:34.757253 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e189d7ec-eb7b-41a7-b29a-c00fab82558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:34.770634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e5ea1f19-e096-4a78-b31e-55e4acfbfecf None None] MFA Rules not processed for user `aecc60e726324c91b17abc7226aa0153`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:34.772799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e5ea1f19-e096-4a78-b31e-55e4acfbfecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:34.858620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1055/2116] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:34.860860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189d7ec-eb7b-41a7-b29a-c00fab82558a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:34.865329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1062/2117] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:34.871124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189d7ec-eb7b-41a7-b29a-c00fab82558a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:34.877435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f29bc5-6904-4433-8638-11db6a147ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:34.877590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea1f19-e096-4a78-b31e-55e4acfbfecf None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:34.878057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f29bc5-6904-4433-8638-11db6a147ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.878385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f29bc5-6904-4433-8638-11db6a147ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.878659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f29bc5-6904-4433-8638-11db6a147ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.879309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f29bc5-6904-4433-8638-11db6a147ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:34.879658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f29bc5-6904-4433-8638-11db6a147ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:34.879906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e5ea1f19-e096-4a78-b31e-55e4acfbfecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:34.881916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f29bc5-6904-4433-8638-11db6a147ed9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:34.897994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1056/2118] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:32:34.901943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f29bc5-6904-4433-8638-11db6a147ed9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:34.914052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f29bc5-6904-4433-8638-11db6a147ed9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:34.919450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db7778-538d-4fb4-8e37-785183c7dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:34.920098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db7778-538d-4fb4-8e37-785183c7dbbd admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.920377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db7778-538d-4fb4-8e37-785183c7dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.920652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db7778-538d-4fb4-8e37-785183c7dbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.921272 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db7778-538d-4fb4-8e37-785183c7dbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:34.923302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db7778-538d-4fb4-8e37-785183c7dbbd admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:34.950967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea1f19-e096-4a78-b31e-55e4acfbfecf None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:34.954630 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308fc91-d096-4bbd-b3cd-e696994cf195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:34.955233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308fc91-d096-4bbd-b3cd-e696994cf195 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:34.955508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308fc91-d096-4bbd-b3cd-e696994cf195 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:34.955777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308fc91-d096-4bbd-b3cd-e696994cf195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:34.965534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308fc91-d096-4bbd-b3cd-e696994cf195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:34.967525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308fc91-d096-4bbd-b3cd-e696994cf195 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:34.977217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1063/2119] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:34.992971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:35.031934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1057/2120] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:34 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:35.035132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308fc91-d096-4bbd-b3cd-e696994cf195 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:35.046659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308fc91-d096-4bbd-b3cd-e696994cf195 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:35.112129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026921e-3bd1-460f-8526-0b59bffcb540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:35.112570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026921e-3bd1-460f-8526-0b59bffcb540 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:35.112844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026921e-3bd1-460f-8526-0b59bffcb540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:35.113165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026921e-3bd1-460f-8526-0b59bffcb540 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:35.113788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026921e-3bd1-460f-8526-0b59bffcb540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:35.116345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026921e-3bd1-460f-8526-0b59bffcb540 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:35.165784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:35.188388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db7778-538d-4fb4-8e37-785183c7dbbd admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:35.223487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1064/2121] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:35 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:35.228275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026921e-3bd1-460f-8526-0b59bffcb540 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:35.239226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026921e-3bd1-460f-8526-0b59bffcb540 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:35.245924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de13069-9458-4313-9126-bdb3a1a7325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:35.246750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de13069-9458-4313-9126-bdb3a1a7325f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:35.247226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de13069-9458-4313-9126-bdb3a1a7325f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:35.247699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de13069-9458-4313-9126-bdb3a1a7325f admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:35.248536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de13069-9458-4313-9126-bdb3a1a7325f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:35.250350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de13069-9458-4313-9126-bdb3a1a7325f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:35.251708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db7778-538d-4fb4-8e37-785183c7dbbd admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:35.255950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28dd0-b516-448e-8f84-8d49a2e557fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:35.256780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28dd0-b516-448e-8f84-8d49a2e557fd service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:35.257117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28dd0-b516-448e-8f84-8d49a2e557fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:35.257456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28dd0-b516-448e-8f84-8d49a2e557fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:35.259444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a2d28dd0-b516-448e-8f84-8d49a2e557fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:35.266244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1065/2122] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:35.267341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de13069-9458-4313-9126-bdb3a1a7325f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:35.281600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de13069-9458-4313-9126-bdb3a1a7325f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:35.290489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74cefc-cc07-49e5-888b-63efd9b2bd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:35.291438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74cefc-cc07-49e5-888b-63efd9b2bd0b admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:35.291986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74cefc-cc07-49e5-888b-63efd9b2bd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:35.292502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74cefc-cc07-49e5-888b-63efd9b2bd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:35.293423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74cefc-cc07-49e5-888b-63efd9b2bd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:35.295817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74cefc-cc07-49e5-888b-63efd9b2bd0b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:35.311166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1066/2123] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:35.315918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74cefc-cc07-49e5-888b-63efd9b2bd0b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:35.348672 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74cefc-cc07-49e5-888b-63efd9b2bd0b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:35.359036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21aae3d-51af-4427-b3d3-6244170113ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:35.360025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aae3d-51af-4427-b3d3-6244170113ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:35.360496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aae3d-51af-4427-b3d3-6244170113ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:35.360950 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aae3d-51af-4427-b3d3-6244170113ef admin admin] PATH_INFO: `/v3/projects/17f98da5d3354d36ae728b5bfbde6012/users/39409ecabf674a8fb3b973b126f0e1a7/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:35.363317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d28dd0-b516-448e-8f84-8d49a2e557fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:35.366376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d28dd0-b516-448e-8f84-8d49a2e557fd service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:35.377316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1058/2124] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:35 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:35.380081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aae3d-51af-4427-b3d3-6244170113ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f98da5d3354d36ae728b5bfbde6012, user_id=39409ecabf674a8fb3b973b126f0e1a7, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:35.383311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aae3d-51af-4427-b3d3-6244170113ef admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:35.393735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28dd0-b516-448e-8f84-8d49a2e557fd service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:35.395989 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a2d28dd0-b516-448e-8f84-8d49a2e557fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:35.417978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28dd0-b516-448e-8f84-8d49a2e557fd service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:35.425614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:35.426383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:35.426658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:35.426932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] PATH_INFO: `/v3/users/bdfe1101334e4cf8b6f29e56dd4b5898` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:35.428307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdfe1101334e4cf8b6f29e56dd4b5898)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:35.430612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:35.800181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1067/2125] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:35 2022] PUT /identity/v3/projects/17f98da5d3354d36ae728b5bfbde6012/users/39409ecabf674a8fb3b973b126f0e1a7/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:35.800181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31edb88-af89-41b4-b18b-aefd92cee6cc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:35.800181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31edb88-af89-41b4-b18b-aefd92cee6cc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:35.800181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31edb88-af89-41b4-b18b-aefd92cee6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:35.827535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c31edb88-af89-41b4-b18b-aefd92cee6cc None None] MFA Rules not processed for user `39409ecabf674a8fb3b973b126f0e1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:35.828775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c31edb88-af89-41b4-b18b-aefd92cee6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:35.892721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1068/2126] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:36.033941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdfe1101334e4cf8b6f29e56dd4b5898'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:36.034662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdfe1101334e4cf8b6f29e56dd4b5898'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:36.048777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdfe1101334e4cf8b6f29e56dd4b5898'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:36.056990 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdfe1101334e4cf8b6f29e56dd4b5898'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:36.074552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31edb88-af89-41b4-b18b-aefd92cee6cc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:36.078010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c31edb88-af89-41b4-b18b-aefd92cee6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:36.150193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31edb88-af89-41b4-b18b-aefd92cee6cc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:36.154240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4982cae-b95d-4cd8-8425-245dbbbd3f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:36.155124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4982cae-b95d-4cd8-8425-245dbbbd3f85 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:36.155403 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4982cae-b95d-4cd8-8425-245dbbbd3f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:36.155675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4982cae-b95d-4cd8-8425-245dbbbd3f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:36.164740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4982cae-b95d-4cd8-8425-245dbbbd3f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:36.164922 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-2861acbb-2ad5-4785-81eb-c0be6109ecb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdfe1101334e4cf8b6f29e56dd4b5898'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:36.166179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4982cae-b95d-4cd8-8425-245dbbbd3f85 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:36.171620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1059/2127] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:35 2022] DELETE /identity/v3/users/bdfe1101334e4cf8b6f29e56dd4b5898 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:36.186232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1069/2128] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:36.186590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49651f-9bb6-430d-9c45-ec2f8b463b56 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:36.186590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49651f-9bb6-430d-9c45-ec2f8b463b56 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:36.186590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49651f-9bb6-430d-9c45-ec2f8b463b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:36.198233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ab49651f-9bb6-430d-9c45-ec2f8b463b56 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:36.199450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ab49651f-9bb6-430d-9c45-ec2f8b463b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:36.263289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1060/2129] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:36.273784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4982cae-b95d-4cd8-8425-245dbbbd3f85 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:36.275324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b4982cae-b95d-4cd8-8425-245dbbbd3f85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:36.359709 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4982cae-b95d-4cd8-8425-245dbbbd3f85 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:36.440705 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0df01-a802-48fb-834d-b9d51207a5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:36.441477 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0df01-a802-48fb-834d-b9d51207a5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:36.441760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0df01-a802-48fb-834d-b9d51207a5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:36.442120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0df01-a802-48fb-834d-b9d51207a5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:36.460878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0df01-a802-48fb-834d-b9d51207a5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:36.462354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0df01-a802-48fb-834d-b9d51207a5d8 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:36.485253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1070/2130] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:36.509082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:36.851421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:37.396451 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49651f-9bb6-430d-9c45-ec2f8b463b56 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:37.398547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ab49651f-9bb6-430d-9c45-ec2f8b463b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:37.426807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49651f-9bb6-430d-9c45-ec2f8b463b56 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:37.432639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0df01-a802-48fb-834d-b9d51207a5d8 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:37.434814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f0f0df01-a802-48fb-834d-b9d51207a5d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:37.436384 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:37.437033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:37.437307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:37.437800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] PATH_INFO: `/v3/projects/aae4e42dab964b538230d7ec306c529c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:37.439136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae4e42dab964b538230d7ec306c529c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:37.441394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:37.453489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0df01-a802-48fb-834d-b9d51207a5d8 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:37.469178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:37.470160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:37.470428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:37.470754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] PATH_INFO: `/v3/users/bf5f25f00f494bb6b77ff4c267f804ec` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:37.472514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5f25f00f494bb6b77ff4c267f804ec)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:37.475116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:37.554470 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae4e42dab964b538230d7ec306c529c', 'request_id': 'req-228a4520-8cdf-481c-8366-84fb9a5e4d13'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:37.560375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae4e42dab964b538230d7ec306c529c', 'request_id': 'req-228a4520-8cdf-481c-8366-84fb9a5e4d13'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:37.576144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae4e42dab964b538230d7ec306c529c', 'request_id': 'req-228a4520-8cdf-481c-8366-84fb9a5e4d13'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:37.667444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] The token cache is being invalidate because project aae4e42dab964b538230d7ec306c529c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:37.667444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:37.670551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:37.673613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1061/2131] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:37 2022] DELETE /identity/v3/projects/aae4e42dab964b538230d7ec306c529c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:37.680757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:37.685014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:37.702121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5f25f00f494bb6b77ff4c267f804ec'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:37.808218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4520-8cdf-481c-8366-84fb9a5e4d13 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:37.809958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:37.810683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:37.811126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:37.812661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] PATH_INFO: `/v3/users/4f71c395a0b047aab3ad824dca20facc` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:37.814034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f71c395a0b047aab3ad824dca20facc)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:37.817830 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:37.827851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5f25f00f494bb6b77ff4c267f804ec'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:37.839697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5f25f00f494bb6b77ff4c267f804ec'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:37.839697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5f25f00f494bb6b77ff4c267f804ec'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:37.860140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5f25f00f494bb6b77ff4c267f804ec'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:37.868350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1071/2132] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:37 2022] DELETE /identity/v3/users/bf5f25f00f494bb6b77ff4c267f804ec => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:37.869745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:37.871466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:37.930097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dc26a-c2b8-4b33-a570-80787b6432dd admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:37.933926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d166298-646e-4284-8b33-c666da347147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:37.934651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d166298-646e-4284-8b33-c666da347147 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:37.934985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d166298-646e-4284-8b33-c666da347147 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:37.935321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d166298-646e-4284-8b33-c666da347147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:37.937202 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0d166298-646e-4284-8b33-c666da347147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:38.006589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d166298-646e-4284-8b33-c666da347147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:38.010315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d166298-646e-4284-8b33-c666da347147 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:38.019225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1072/2133] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:38.020349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb73d69-4858-4659-870a-c4a9deaa11a7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:38.020699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb73d69-4858-4659-870a-c4a9deaa11a7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:38.020983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb73d69-4858-4659-870a-c4a9deaa11a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:38.042624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6fb73d69-4858-4659-870a-c4a9deaa11a7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:38.044495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6fb73d69-4858-4659-870a-c4a9deaa11a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:38.082807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f71c395a0b047aab3ad824dca20facc'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:38.083548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f71c395a0b047aab3ad824dca20facc'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:38.105940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f71c395a0b047aab3ad824dca20facc'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:38.114046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f71c395a0b047aab3ad824dca20facc'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:38.158486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:38.164832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1073/2134] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:38.188720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb73d69-4858-4659-870a-c4a9deaa11a7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:38.190487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6fb73d69-4858-4659-870a-c4a9deaa11a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:38.205839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f71c395a0b047aab3ad824dca20facc'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:38.218039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1062/2135] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:37 2022] DELETE /identity/v3/users/4f71c395a0b047aab3ad824dca20facc => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:38.287653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb73d69-4858-4659-870a-c4a9deaa11a7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:38.359561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608dbc2-f609-49d0-8dc5-750a9ec51624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:38.360308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608dbc2-f609-49d0-8dc5-750a9ec51624 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:38.360600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608dbc2-f609-49d0-8dc5-750a9ec51624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:38.360879 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608dbc2-f609-49d0-8dc5-750a9ec51624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:38.369619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4608dbc2-f609-49d0-8dc5-750a9ec51624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:38.469854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608dbc2-f609-49d0-8dc5-750a9ec51624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:38.471553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608dbc2-f609-49d0-8dc5-750a9ec51624 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:38.490831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1074/2136] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:38.571797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:39.103863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:39.105642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:39.127532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2ed84-5ada-4254-982d-be8e1cf3150b admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:39.133088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:39.133740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:39.134193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:39.134473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] PATH_INFO: `/v3/projects/6299b52af1f7407ebe7f8b238e7ad7fd` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:39.135785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6299b52af1f7407ebe7f8b238e7ad7fd)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:39.138734 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:39.267985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608dbc2-f609-49d0-8dc5-750a9ec51624 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:39.267985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4608dbc2-f609-49d0-8dc5-750a9ec51624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:39.281757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608dbc2-f609-49d0-8dc5-750a9ec51624 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:39.284610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6299b52af1f7407ebe7f8b238e7ad7fd', 'request_id': 'req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.297729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6299b52af1f7407ebe7f8b238e7ad7fd', 'request_id': 'req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.310343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6299b52af1f7407ebe7f8b238e7ad7fd', 'request_id': 'req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.378440 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:39.379451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:39.379825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:39.380131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] PATH_INFO: `/v3/projects/7da6b851472246f9a3478b1d27ae78e2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:39.386156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da6b851472246f9a3478b1d27ae78e2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:39.386156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:39.445563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] The token cache is being invalidate because project 6299b52af1f7407ebe7f8b238e7ad7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:39.445563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.445563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a2e7c15-a09b-4398-ba14-1e9aba256ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.447938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1063/2137] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:39 2022] DELETE /identity/v3/projects/6299b52af1f7407ebe7f8b238e7ad7fd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:39.452788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbbe34-2330-40e9-8793-7e8d5eebedbe None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:39.453097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbbe34-2330-40e9-8793-7e8d5eebedbe None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:39.453358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbbe34-2330-40e9-8793-7e8d5eebedbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:39.498345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-69dbbe34-2330-40e9-8793-7e8d5eebedbe None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:39.498345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-69dbbe34-2330-40e9-8793-7e8d5eebedbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:39.515930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1064/2138] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:39.517403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbbe34-2330-40e9-8793-7e8d5eebedbe None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:39.518695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-69dbbe34-2330-40e9-8793-7e8d5eebedbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:39.556607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da6b851472246f9a3478b1d27ae78e2', 'request_id': 'req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.563160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da6b851472246f9a3478b1d27ae78e2', 'request_id': 'req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.564009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbbe34-2330-40e9-8793-7e8d5eebedbe None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:39.582321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da6b851472246f9a3478b1d27ae78e2', 'request_id': 'req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.632344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:39.632999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:39.633278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:39.633548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] PATH_INFO: `/v3/users/233ccfdda18d43f7b1fd585ca74037f8` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:39.634675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] RBAC: Authorizing `identity:delete_user(user_id=233ccfdda18d43f7b1fd585ca74037f8)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:39.636815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:39.641079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:39.675552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] The token cache is being invalidate because project 7da6b851472246f9a3478b1d27ae78e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:39.676128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.677210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7fcc4eef-36b0-4f40-ad35-b9b50c34198e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.679161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1075/2139] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:39 2022] DELETE /identity/v3/projects/7da6b851472246f9a3478b1d27ae78e2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:39.680736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5631a-2373-42c3-a18c-822b1b0f69c3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:39.681017 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5631a-2373-42c3-a18c-822b1b0f69c3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:39.681281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5631a-2373-42c3-a18c-822b1b0f69c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:39.704375 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-cfd5631a-2373-42c3-a18c-822b1b0f69c3 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:39.705897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cfd5631a-2373-42c3-a18c-822b1b0f69c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:39.713643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1076/2140] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:39.714818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3feb7b-779e-40dc-b01e-01b7b7f7669a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:39.715098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3feb7b-779e-40dc-b01e-01b7b7f7669a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:39.715367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3feb7b-779e-40dc-b01e-01b7b7f7669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:39.737722 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-af3feb7b-779e-40dc-b01e-01b7b7f7669a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:39.738922 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-af3feb7b-779e-40dc-b01e-01b7b7f7669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:39.748741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1077/2141] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:39.749655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3feb7b-779e-40dc-b01e-01b7b7f7669a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:39.756743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:39.762740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3feb7b-779e-40dc-b01e-01b7b7f7669a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:39.767533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192f746-8663-4f9c-bd8e-4c126b293fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:39.768167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192f746-8663-4f9c-bd8e-4c126b293fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:39.768459 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192f746-8663-4f9c-bd8e-4c126b293fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:39.768710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192f746-8663-4f9c-bd8e-4c126b293fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:39.769370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192f746-8663-4f9c-bd8e-4c126b293fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:39.769647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192f746-8663-4f9c-bd8e-4c126b293fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:39.771736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192f746-8663-4f9c-bd8e-4c126b293fa4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:39.783279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1078/2142] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:39.784993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f783fb-b173-44bf-8fc1-cc0f6db7e47d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:39.787943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f783fb-b173-44bf-8fc1-cc0f6db7e47d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:39.787943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f783fb-b173-44bf-8fc1-cc0f6db7e47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:39.808132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-27f783fb-b173-44bf-8fc1-cc0f6db7e47d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:39.809349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-27f783fb-b173-44bf-8fc1-cc0f6db7e47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:39.819120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1079/2143] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:39.824457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f783fb-b173-44bf-8fc1-cc0f6db7e47d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:39.829867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f783fb-b173-44bf-8fc1-cc0f6db7e47d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:39.835152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c8b41-1b92-4fa7-8ddf-4dbea4bc9771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:39.835755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c8b41-1b92-4fa7-8ddf-4dbea4bc9771 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:39.836076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c8b41-1b92-4fa7-8ddf-4dbea4bc9771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:39.836358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c8b41-1b92-4fa7-8ddf-4dbea4bc9771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:39.836992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c8b41-1b92-4fa7-8ddf-4dbea4bc9771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:39.838941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c8b41-1b92-4fa7-8ddf-4dbea4bc9771 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:39.859211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233ccfdda18d43f7b1fd585ca74037f8'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.859929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233ccfdda18d43f7b1fd585ca74037f8'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.872580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233ccfdda18d43f7b1fd585ca74037f8'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.880093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233ccfdda18d43f7b1fd585ca74037f8'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.955099 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1080/2144] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:39.955996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c8b41-1b92-4fa7-8ddf-4dbea4bc9771 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:39.957560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f77c8b41-1b92-4fa7-8ddf-4dbea4bc9771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:39.970657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233ccfdda18d43f7b1fd585ca74037f8'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:39.977804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1065/2145] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:39 2022] DELETE /identity/v3/users/233ccfdda18d43f7b1fd585ca74037f8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:39.978877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:39.980211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:40.019185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c8b41-1b92-4fa7-8ddf-4dbea4bc9771 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.058751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf873275-bb75-497e-a7d5-55fcb445d00f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.065784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac67f8-b5ca-4450-9a3c-a5f35f1fd9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.068592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac67f8-b5ca-4450-9a3c-a5f35f1fd9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.068592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac67f8-b5ca-4450-9a3c-a5f35f1fd9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.068592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac67f8-b5ca-4450-9a3c-a5f35f1fd9d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.069065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac67f8-b5ca-4450-9a3c-a5f35f1fd9d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:40.069372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac67f8-b5ca-4450-9a3c-a5f35f1fd9d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.071385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac67f8-b5ca-4450-9a3c-a5f35f1fd9d2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.079137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e5913-9a62-4827-baf1-a74253009fb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.079899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e5913-9a62-4827-baf1-a74253009fb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.080245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e5913-9a62-4827-baf1-a74253009fb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.080590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e5913-9a62-4827-baf1-a74253009fb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.082713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b13e5913-9a62-4827-baf1-a74253009fb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:40.091285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1066/2146] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:40.092320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac67f8-b5ca-4450-9a3c-a5f35f1fd9d2 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.094310 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c4ac67f8-b5ca-4450-9a3c-a5f35f1fd9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:40.108765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac67f8-b5ca-4450-9a3c-a5f35f1fd9d2 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.128457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22641053-786c-4b7e-9207-2a338a78e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.128457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22641053-786c-4b7e-9207-2a338a78e43e admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.128457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22641053-786c-4b7e-9207-2a338a78e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.128457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22641053-786c-4b7e-9207-2a338a78e43e admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.128769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22641053-786c-4b7e-9207-2a338a78e43e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.128769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22641053-786c-4b7e-9207-2a338a78e43e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.169717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e5913-9a62-4827-baf1-a74253009fb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.171171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e5913-9a62-4827-baf1-a74253009fb4 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.182046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1081/2147] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:40.190478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e5913-9a62-4827-baf1-a74253009fb4 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.195450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e5913-9a62-4827-baf1-a74253009fb4 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.201559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367286a-f828-45d9-8d22-50f793ca4742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.202203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367286a-f828-45d9-8d22-50f793ca4742 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.202477 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367286a-f828-45d9-8d22-50f793ca4742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.202743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367286a-f828-45d9-8d22-50f793ca4742 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.203391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367286a-f828-45d9-8d22-50f793ca4742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.205656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367286a-f828-45d9-8d22-50f793ca4742 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.266571 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1067/2148] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:40 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:40.270707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22641053-786c-4b7e-9207-2a338a78e43e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.280946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22641053-786c-4b7e-9207-2a338a78e43e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.285979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeb39b-ab0d-4c0b-99e6-e4af4f6852c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.286618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeb39b-ab0d-4c0b-99e6-e4af4f6852c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.286941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeb39b-ab0d-4c0b-99e6-e4af4f6852c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.287213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeb39b-ab0d-4c0b-99e6-e4af4f6852c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.287848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeb39b-ab0d-4c0b-99e6-e4af4f6852c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.292124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeb39b-ab0d-4c0b-99e6-e4af4f6852c4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.301257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1082/2149] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:40.302409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367286a-f828-45d9-8d22-50f793ca4742 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.306105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8367286a-f828-45d9-8d22-50f793ca4742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:40.312140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1068/2150] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:32:40.312140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeb39b-ab0d-4c0b-99e6-e4af4f6852c4 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.331206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeb39b-ab0d-4c0b-99e6-e4af4f6852c4 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.378862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367286a-f828-45d9-8d22-50f793ca4742 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.384171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.384807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.385089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.385359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] PATH_INFO: `/v3/projects/3e8f00d9ff52437facea6edfde4920e0` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.386474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8f00d9ff52437facea6edfde4920e0)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.387268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bcf9c-5798-45b6-bdf2-ff936e858559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.387870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bcf9c-5798-45b6-bdf2-ff936e858559 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.388270 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bcf9c-5798-45b6-bdf2-ff936e858559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.388454 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.388560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bcf9c-5798-45b6-bdf2-ff936e858559 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.389161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bcf9c-5798-45b6-bdf2-ff936e858559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.391066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bcf9c-5798-45b6-bdf2-ff936e858559 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.514167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1069/2151] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:40 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:40.515058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bcf9c-5798-45b6-bdf2-ff936e858559 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.525222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bcf9c-5798-45b6-bdf2-ff936e858559 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.530013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ccc1-a6b7-4c29-acb3-8871be4acc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.534975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ccc1-a6b7-4c29-acb3-8871be4acc1e admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.534975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ccc1-a6b7-4c29-acb3-8871be4acc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.534975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ccc1-a6b7-4c29-acb3-8871be4acc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.534975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71ccc1-a6b7-4c29-acb3-8871be4acc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.534975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71ccc1-a6b7-4c29-acb3-8871be4acc1e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.547362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1070/2152] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:40.549114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ccc1-a6b7-4c29-acb3-8871be4acc1e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.559785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ccc1-a6b7-4c29-acb3-8871be4acc1e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.571526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8f00d9ff52437facea6edfde4920e0', 'request_id': 'req-cb2c852a-7095-4d07-9930-586a7c5aefdd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:40.577606 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8f00d9ff52437facea6edfde4920e0', 'request_id': 'req-cb2c852a-7095-4d07-9930-586a7c5aefdd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:40.584653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8f00d9ff52437facea6edfde4920e0', 'request_id': 'req-cb2c852a-7095-4d07-9930-586a7c5aefdd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:40.617877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef95b-e98a-4f8d-8a02-365f4386e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.618487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef95b-e98a-4f8d-8a02-365f4386e8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.618764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef95b-e98a-4f8d-8a02-365f4386e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.619064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef95b-e98a-4f8d-8a02-365f4386e8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.619713 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcef95b-e98a-4f8d-8a02-365f4386e8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.621454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcef95b-e98a-4f8d-8a02-365f4386e8b1 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.631734 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1071/2153] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:40.632432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef95b-e98a-4f8d-8a02-365f4386e8b1 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.642135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef95b-e98a-4f8d-8a02-365f4386e8b1 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.647401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388e924-4fcf-4d04-8e81-c8079b074c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.648079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e924-4fcf-4d04-8e81-c8079b074c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.648361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e924-4fcf-4d04-8e81-c8079b074c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.648636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e924-4fcf-4d04-8e81-c8079b074c3f admin admin] PATH_INFO: `/v3/projects/d2855e7f4c124d0e90816dad4ff314fc/users/ff67ad579971489695b0100d1ce3ba56/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.664789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388e924-4fcf-4d04-8e81-c8079b074c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2855e7f4c124d0e90816dad4ff314fc, user_id=ff67ad579971489695b0100d1ce3ba56, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.667500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388e924-4fcf-4d04-8e81-c8079b074c3f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.697059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] The token cache is being invalidate because project 3e8f00d9ff52437facea6edfde4920e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:40.697769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:40.698804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:40.700880 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1083/2154] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:40 2022] DELETE /identity/v3/projects/3e8f00d9ff52437facea6edfde4920e0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:40.702848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.704621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:40.725925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c852a-7095-4d07-9930-586a7c5aefdd admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.731024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd3ea8-f8fc-43e5-8188-2a0afa9111d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.731669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd3ea8-f8fc-43e5-8188-2a0afa9111d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.732022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd3ea8-f8fc-43e5-8188-2a0afa9111d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.732312 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd3ea8-f8fc-43e5-8188-2a0afa9111d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.732948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd3ea8-f8fc-43e5-8188-2a0afa9111d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.734579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd3ea8-f8fc-43e5-8188-2a0afa9111d4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.746170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1084/2155] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:40.747462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dfe5b-c79a-45b0-95a0-6410264635ee None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.747938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dfe5b-c79a-45b0-95a0-6410264635ee None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.748372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dfe5b-c79a-45b0-95a0-6410264635ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.769332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-037dfe5b-c79a-45b0-95a0-6410264635ee None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:40.770542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-037dfe5b-c79a-45b0-95a0-6410264635ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:40.771031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1072/2156] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:40 2022] PUT /identity/v3/projects/d2855e7f4c124d0e90816dad4ff314fc/users/ff67ad579971489695b0100d1ce3ba56/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:40.772350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388e924-4fcf-4d04-8e81-c8079b074c3f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.843178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1085/2157] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:40.844496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7c41-9f6c-43df-97c8-65e2397a067c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.844777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7c41-9f6c-43df-97c8-65e2397a067c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.845047 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7c41-9f6c-43df-97c8-65e2397a067c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.846397 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388e924-4fcf-4d04-8e81-c8079b074c3f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:40.852017 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cb1f8-0ff1-4197-9a8a-43ea8a0f9420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:40.852682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cb1f8-0ff1-4197-9a8a-43ea8a0f9420 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.853105 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cb1f8-0ff1-4197-9a8a-43ea8a0f9420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.853465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cb1f8-0ff1-4197-9a8a-43ea8a0f9420 admin admin] PATH_INFO: `/v3/projects/ee05ea8a6bb4424bade5f9e9fa09ad54/users/196e33313a294e7f93cebd8f9b364eb3/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.869074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cb1f8-0ff1-4197-9a8a-43ea8a0f9420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee05ea8a6bb4424bade5f9e9fa09ad54, user_id=196e33313a294e7f93cebd8f9b364eb3, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:40.871869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cb1f8-0ff1-4197-9a8a-43ea8a0f9420 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:40.875055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bdff7c41-9f6c-43df-97c8-65e2397a067c None None] MFA Rules not processed for user `ff67ad579971489695b0100d1ce3ba56`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:40.876292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bdff7c41-9f6c-43df-97c8-65e2397a067c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:40.940603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1086/2158] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:40.941924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ed49-7576-48f4-ae94-cb8e55a62a5c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:40.942225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ed49-7576-48f4-ae94-cb8e55a62a5c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:40.942490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ed49-7576-48f4-ae94-cb8e55a62a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:40.970484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3d90ed49-7576-48f4-ae94-cb8e55a62a5c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:40.970484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3d90ed49-7576-48f4-ae94-cb8e55a62a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:40.970670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1073/2159] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:40 2022] PUT /identity/v3/projects/ee05ea8a6bb4424bade5f9e9fa09ad54/users/196e33313a294e7f93cebd8f9b364eb3/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:40.970670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cb1f8-0ff1-4197-9a8a-43ea8a0f9420 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:40.971655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ec2cb1f8-0ff1-4197-9a8a-43ea8a0f9420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:41.030193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1087/2160] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:41.031505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6e5b-550e-4294-8c08-dd64cc40da49 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.031784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6e5b-550e-4294-8c08-dd64cc40da49 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.032081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6e5b-550e-4294-8c08-dd64cc40da49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.042267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cb1f8-0ff1-4197-9a8a-43ea8a0f9420 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.047827 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7fd04-ff3d-4723-9b80-76037e6dcba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.048467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7fd04-ff3d-4723-9b80-76037e6dcba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.048805 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7fd04-ff3d-4723-9b80-76037e6dcba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.049081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7fd04-ff3d-4723-9b80-76037e6dcba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.049718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7fd04-ff3d-4723-9b80-76037e6dcba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.052298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7fd04-ff3d-4723-9b80-76037e6dcba9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.060147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-075a6e5b-550e-4294-8c08-dd64cc40da49 None None] MFA Rules not processed for user `196e33313a294e7f93cebd8f9b364eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:41.061365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-075a6e5b-550e-4294-8c08-dd64cc40da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:41.114256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:41.127087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1088/2161] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:41.127959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6e5b-550e-4294-8c08-dd64cc40da49 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.138721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6e5b-550e-4294-8c08-dd64cc40da49 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.143558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8244c76-9ad1-4301-a077-987a43b2e8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.144207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8244c76-9ad1-4301-a077-987a43b2e8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.144493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8244c76-9ad1-4301-a077-987a43b2e8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.144891 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8244c76-9ad1-4301-a077-987a43b2e8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.145701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8244c76-9ad1-4301-a077-987a43b2e8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:41.149555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8244c76-9ad1-4301-a077-987a43b2e8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.149555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8244c76-9ad1-4301-a077-987a43b2e8d7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.159419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1089/2162] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:41.160237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8244c76-9ad1-4301-a077-987a43b2e8d7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.170028 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8244c76-9ad1-4301-a077-987a43b2e8d7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.174727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870260-4f3f-4b18-b906-aafe80e0818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.178280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870260-4f3f-4b18-b906-aafe80e0818a admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.178280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870260-4f3f-4b18-b906-aafe80e0818a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.178280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870260-4f3f-4b18-b906-aafe80e0818a admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.178280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20870260-4f3f-4b18-b906-aafe80e0818a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.178553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1074/2163] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:40 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:41.178553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7fd04-ff3d-4723-9b80-76037e6dcba9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.178706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20870260-4f3f-4b18-b906-aafe80e0818a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.241022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7fd04-ff3d-4723-9b80-76037e6dcba9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.245852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b44a0-02b1-41bc-905b-cebac5956d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.246449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b44a0-02b1-41bc-905b-cebac5956d3f admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.246720 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b44a0-02b1-41bc-905b-cebac5956d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.246985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b44a0-02b1-41bc-905b-cebac5956d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.247603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b44a0-02b1-41bc-905b-cebac5956d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.249566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b44a0-02b1-41bc-905b-cebac5956d3f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.279606 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:41.286725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1090/2164] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:41 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:41.287789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870260-4f3f-4b18-b906-aafe80e0818a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.348196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870260-4f3f-4b18-b906-aafe80e0818a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.353021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7f905-05fb-43ba-be8f-1b9d4fab101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.353655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f905-05fb-43ba-be8f-1b9d4fab101a admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.353929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f905-05fb-43ba-be8f-1b9d4fab101a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.354203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f905-05fb-43ba-be8f-1b9d4fab101a admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.354826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7f905-05fb-43ba-be8f-1b9d4fab101a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.356799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7f905-05fb-43ba-be8f-1b9d4fab101a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.367412 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1075/2165] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:41 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:41.368350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b44a0-02b1-41bc-905b-cebac5956d3f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.369925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a74b44a0-02b1-41bc-905b-cebac5956d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:41.432814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b44a0-02b1-41bc-905b-cebac5956d3f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.437448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.438074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.438353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.438635 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] PATH_INFO: `/v3/users/8eeea64b71204f268c9cbe8118ccb845` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.439763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eeea64b71204f268c9cbe8118ccb845)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.441720 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.456860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1091/2166] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:41 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:41.456860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7f905-05fb-43ba-be8f-1b9d4fab101a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.469743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7f905-05fb-43ba-be8f-1b9d4fab101a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.474517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be6ff8-66da-43d9-98b4-bd2c0265f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.475123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6ff8-66da-43d9-98b4-bd2c0265f65f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.475393 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6ff8-66da-43d9-98b4-bd2c0265f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.475663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6ff8-66da-43d9-98b4-bd2c0265f65f admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.476315 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be6ff8-66da-43d9-98b4-bd2c0265f65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.478219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be6ff8-66da-43d9-98b4-bd2c0265f65f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.588806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1092/2167] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:41 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:41.590457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be6ff8-66da-43d9-98b4-bd2c0265f65f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.600668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be6ff8-66da-43d9-98b4-bd2c0265f65f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.605747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb3fe-7c3b-492b-b98a-dd13130005dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.606417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb3fe-7c3b-492b-b98a-dd13130005dd admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.606688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb3fe-7c3b-492b-b98a-dd13130005dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.606955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb3fe-7c3b-492b-b98a-dd13130005dd admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.607568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdb3fe-7c3b-492b-b98a-dd13130005dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.609590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdb3fe-7c3b-492b-b98a-dd13130005dd admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.652447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eeea64b71204f268c9cbe8118ccb845'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:41.653109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eeea64b71204f268c9cbe8118ccb845'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:41.665046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eeea64b71204f268c9cbe8118ccb845'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:41.673286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eeea64b71204f268c9cbe8118ccb845'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:41.703965 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1093/2168] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:41 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:41.704806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb3fe-7c3b-492b-b98a-dd13130005dd admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.714309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb3fe-7c3b-492b-b98a-dd13130005dd admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.719157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2474e-c5da-4cc2-a758-93113b5bff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.719728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2474e-c5da-4cc2-a758-93113b5bff89 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.720037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2474e-c5da-4cc2-a758-93113b5bff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.720304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2474e-c5da-4cc2-a758-93113b5bff89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.720927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2474e-c5da-4cc2-a758-93113b5bff89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.722615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2474e-c5da-4cc2-a758-93113b5bff89 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.735866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1094/2169] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:41.735866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2474e-c5da-4cc2-a758-93113b5bff89 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.744128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2474e-c5da-4cc2-a758-93113b5bff89 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.753587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f58bf-f898-4512-b09c-cf81d8f92b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.753587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f58bf-f898-4512-b09c-cf81d8f92b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.753587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f58bf-f898-4512-b09c-cf81d8f92b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.753587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f58bf-f898-4512-b09c-cf81d8f92b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.753943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f58bf-f898-4512-b09c-cf81d8f92b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.753943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f58bf-f898-4512-b09c-cf81d8f92b78 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.759116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eeea64b71204f268c9cbe8118ccb845'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:41.763071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1095/2170] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:41.763853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f58bf-f898-4512-b09c-cf81d8f92b78 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.766069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1076/2171] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:41 2022] DELETE /identity/v3/users/8eeea64b71204f268c9cbe8118ccb845 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:41.768576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-078f58bf-f898-4512-b09c-cf81d8f92b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:41.769856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.771233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:41.783252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f58bf-f898-4512-b09c-cf81d8f92b78 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.810101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:41.855015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3f964-4e11-48aa-b5a2-975b207838b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.855654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f964-4e11-48aa-b5a2-975b207838b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.860000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f964-4e11-48aa-b5a2-975b207838b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.860000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f964-4e11-48aa-b5a2-975b207838b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.860000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3f964-4e11-48aa-b5a2-975b207838b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.860000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3f964-4e11-48aa-b5a2-975b207838b6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.869550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273921c-b723-403d-be1d-0ca3884a5420 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.870775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1096/2172] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:41.871771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3f964-4e11-48aa-b5a2-975b207838b6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.874142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2ca3f964-4e11-48aa-b5a2-975b207838b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:41.877694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffbc8d-af76-4f00-b2b9-55b46486e6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.878408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffbc8d-af76-4f00-b2b9-55b46486e6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.878756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffbc8d-af76-4f00-b2b9-55b46486e6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.879092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffbc8d-af76-4f00-b2b9-55b46486e6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.879852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffbc8d-af76-4f00-b2b9-55b46486e6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.881612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffbc8d-af76-4f00-b2b9-55b46486e6e4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.887387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3f964-4e11-48aa-b5a2-975b207838b6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.892333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7907f-6741-416c-9734-27bafcb79cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.893007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7907f-6741-416c-9734-27bafcb79cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.893287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7907f-6741-416c-9734-27bafcb79cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.893521 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7907f-6741-416c-9734-27bafcb79cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.894143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7907f-6741-416c-9734-27bafcb79cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.895735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7907f-6741-416c-9734-27bafcb79cd5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.901422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1077/2173] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:41.901422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d017041-dcbc-429c-8381-83d8f9a39cc9 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.901422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d017041-dcbc-429c-8381-83d8f9a39cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.901422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d017041-dcbc-429c-8381-83d8f9a39cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.908959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1097/2174] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:41.910065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7907f-6741-416c-9734-27bafcb79cd5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.926018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5d017041-dcbc-429c-8381-83d8f9a39cc9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:41.927255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5d017041-dcbc-429c-8381-83d8f9a39cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:41.930532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7907f-6741-416c-9734-27bafcb79cd5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.936193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1078/2175] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:41.938480 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ed183-8161-4b8e-98ab-765130450953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.938596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d017041-dcbc-429c-8381-83d8f9a39cc9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.938680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ed183-8161-4b8e-98ab-765130450953 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.938680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ed183-8161-4b8e-98ab-765130450953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.938680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ed183-8161-4b8e-98ab-765130450953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.938680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ed183-8161-4b8e-98ab-765130450953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.940050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ed183-8161-4b8e-98ab-765130450953 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.946881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d017041-dcbc-429c-8381-83d8f9a39cc9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.950719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1098/2176] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:41.952169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd827a-9a3a-4948-8767-137282452899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.952838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd827a-9a3a-4948-8767-137282452899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.953117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd827a-9a3a-4948-8767-137282452899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.953392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd827a-9a3a-4948-8767-137282452899 admin admin] PATH_INFO: `/v3/projects/575591832d5e4b049a99b51822845e98/users/81650d705d1f4c9ca6c4d23f2c15a43e/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.955100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ed183-8161-4b8e-98ab-765130450953 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:41.966406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ed183-8161-4b8e-98ab-765130450953 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:41.969127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd827a-9a3a-4948-8767-137282452899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575591832d5e4b049a99b51822845e98, user_id=81650d705d1f4c9ca6c4d23f2c15a43e, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.971793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd827a-9a3a-4948-8767-137282452899 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:41.972669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fc4cc-89df-44c7-91a0-da40205189d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:41.973815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fc4cc-89df-44c7-91a0-da40205189d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:41.974747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fc4cc-89df-44c7-91a0-da40205189d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:41.975165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fc4cc-89df-44c7-91a0-da40205189d2 admin admin] PATH_INFO: `/v3/projects/ce2878887645409f92e7970d2248d573/users/3558a11f6a994183b087126e1fd48678/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:41.990763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fc4cc-89df-44c7-91a0-da40205189d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2878887645409f92e7970d2248d573, user_id=3558a11f6a994183b087126e1fd48678, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:41.993939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fc4cc-89df-44c7-91a0-da40205189d2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:42.059138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1079/2177] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:41 2022] PUT /identity/v3/projects/575591832d5e4b049a99b51822845e98/users/81650d705d1f4c9ca6c4d23f2c15a43e/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:42.059138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd827a-9a3a-4948-8767-137282452899 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:42.059138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5cbd827a-9a3a-4948-8767-137282452899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:42.122088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1099/2178] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:41 2022] PUT /identity/v3/projects/ce2878887645409f92e7970d2248d573/users/3558a11f6a994183b087126e1fd48678/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:42.123262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fc4cc-89df-44c7-91a0-da40205189d2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:42.126965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd827a-9a3a-4948-8767-137282452899 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:42.182329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28ad39-c891-4e84-b0dd-da36037376c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:42.183549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ad39-c891-4e84-b0dd-da36037376c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.184105 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ad39-c891-4e84-b0dd-da36037376c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.184604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ad39-c891-4e84-b0dd-da36037376c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.190958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fc4cc-89df-44c7-91a0-da40205189d2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:42.195410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28ad39-c891-4e84-b0dd-da36037376c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:42.196964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28ad39-c891-4e84-b0dd-da36037376c8 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:42.197903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745d868-15c4-4b38-b536-313bc80b6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:42.198688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d868-15c4-4b38-b536-313bc80b6b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.199090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d868-15c4-4b38-b536-313bc80b6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.199462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d868-15c4-4b38-b536-313bc80b6b42 admin admin] PATH_INFO: `/v3/projects/c9ba0e8081a2479d9c6dec428e57d2b4/users/ad3ff41148f347f2993d31a04739accc/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.207271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1080/2179] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:42.209095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7416-c2a3-4a4f-b137-38e1702ff8f3 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.209421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7416-c2a3-4a4f-b137-38e1702ff8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.209765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7416-c2a3-4a4f-b137-38e1702ff8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.216513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745d868-15c4-4b38-b536-313bc80b6b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ba0e8081a2479d9c6dec428e57d2b4, user_id=ad3ff41148f347f2993d31a04739accc, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:42.219563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745d868-15c4-4b38-b536-313bc80b6b42 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:42.242403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ac2d7416-c2a3-4a4f-b137-38e1702ff8f3 None None] MFA Rules not processed for user `81650d705d1f4c9ca6c4d23f2c15a43e`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:42.244343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ac2d7416-c2a3-4a4f-b137-38e1702ff8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:42.313177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1081/2180] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:42.314368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7af86-b42e-4a69-8943-17271f8bec53 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.314655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7af86-b42e-4a69-8943-17271f8bec53 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.314932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7af86-b42e-4a69-8943-17271f8bec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.342614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-20b7af86-b42e-4a69-8943-17271f8bec53 None None] MFA Rules not processed for user `3558a11f6a994183b087126e1fd48678`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:42.343812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-20b7af86-b42e-4a69-8943-17271f8bec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:42.371619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1100/2181] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:42 2022] PUT /identity/v3/projects/c9ba0e8081a2479d9c6dec428e57d2b4/users/ad3ff41148f347f2993d31a04739accc/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:42.372482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745d868-15c4-4b38-b536-313bc80b6b42 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:42.411271 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1082/2182] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:42.412484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ceff-7035-40f1-b0bf-3b4cb7b0d604 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.412770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ceff-7035-40f1-b0bf-3b4cb7b0d604 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.413039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ceff-7035-40f1-b0bf-3b4cb7b0d604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.423214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:42.442448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745d868-15c4-4b38-b536-313bc80b6b42 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:42.450602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed2ce-e7c0-4659-8bf2-73beca06e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:42.451465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed2ce-e7c0-4659-8bf2-73beca06e834 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.451775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed2ce-e7c0-4659-8bf2-73beca06e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.452131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed2ce-e7c0-4659-8bf2-73beca06e834 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.453084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ed2ce-e7c0-4659-8bf2-73beca06e834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:42.455225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ed2ce-e7c0-4659-8bf2-73beca06e834 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:42.457040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a9a8ceff-7035-40f1-b0bf-3b4cb7b0d604 None None] MFA Rules not processed for user `ad3ff41148f347f2993d31a04739accc`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:42.460504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a9a8ceff-7035-40f1-b0bf-3b4cb7b0d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:42.528075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1083/2183] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:42.528902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ceff-7035-40f1-b0bf-3b4cb7b0d604 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:42.539579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ceff-7035-40f1-b0bf-3b4cb7b0d604 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:42.544350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e221b-00d1-4b7e-a720-65ad86669f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:42.544944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e221b-00d1-4b7e-a720-65ad86669f4d admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.545224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e221b-00d1-4b7e-a720-65ad86669f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.545495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e221b-00d1-4b7e-a720-65ad86669f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.546120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e221b-00d1-4b7e-a720-65ad86669f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:42.548120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e221b-00d1-4b7e-a720-65ad86669f4d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:42.596455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1101/2184] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:42 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:42.597560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed2ce-e7c0-4659-8bf2-73beca06e834 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:42.654402 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1084/2185] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:42 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:42.654402 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e221b-00d1-4b7e-a720-65ad86669f4d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:42.664543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed2ce-e7c0-4659-8bf2-73beca06e834 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:42.712481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e221b-00d1-4b7e-a720-65ad86669f4d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:42.717260 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cf20c-0cd2-4c75-a4b0-c65001d83f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:42.717907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cf20c-0cd2-4c75-a4b0-c65001d83f9a admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.718179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cf20c-0cd2-4c75-a4b0-c65001d83f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.718449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cf20c-0cd2-4c75-a4b0-c65001d83f9a admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.719071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cf20c-0cd2-4c75-a4b0-c65001d83f9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:42.720896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8b00e-3c06-4454-83ce-2596c0c18211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:42.721036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cf20c-0cd2-4c75-a4b0-c65001d83f9a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:42.721506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b00e-3c06-4454-83ce-2596c0c18211 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.721857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b00e-3c06-4454-83ce-2596c0c18211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.722127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b00e-3c06-4454-83ce-2596c0c18211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.722746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8b00e-3c06-4454-83ce-2596c0c18211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:42.724736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8b00e-3c06-4454-83ce-2596c0c18211 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:42.812547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1085/2186] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:42 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:42.812547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cf20c-0cd2-4c75-a4b0-c65001d83f9a admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:42.812547 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1a1cf20c-0cd2-4c75-a4b0-c65001d83f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:42.824609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cf20c-0cd2-4c75-a4b0-c65001d83f9a admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:42.830124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:42.830752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.831030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.831303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] PATH_INFO: `/v3/projects/ce0abbc5d60d48ff91da7ee4858a28e2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.832500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0abbc5d60d48ff91da7ee4858a28e2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:42.834416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:42.838787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1102/2187] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:42 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:42.838787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8b00e-3c06-4454-83ce-2596c0c18211 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:42.898014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8b00e-3c06-4454-83ce-2596c0c18211 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:42.902602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969d5b5-a1e6-42ca-9370-cd42bd8f3846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:42.903200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969d5b5-a1e6-42ca-9370-cd42bd8f3846 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:42.903474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969d5b5-a1e6-42ca-9370-cd42bd8f3846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:42.903745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969d5b5-a1e6-42ca-9370-cd42bd8f3846 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:42.904391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969d5b5-a1e6-42ca-9370-cd42bd8f3846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:42.906306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969d5b5-a1e6-42ca-9370-cd42bd8f3846 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:42.955140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0abbc5d60d48ff91da7ee4858a28e2', 'request_id': 'req-b99999cc-0dca-4fd8-8277-4df1251efcd3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:42.960729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0abbc5d60d48ff91da7ee4858a28e2', 'request_id': 'req-b99999cc-0dca-4fd8-8277-4df1251efcd3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:42.967319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0abbc5d60d48ff91da7ee4858a28e2', 'request_id': 'req-b99999cc-0dca-4fd8-8277-4df1251efcd3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:43.011858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1103/2188] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:42 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:43.011858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969d5b5-a1e6-42ca-9370-cd42bd8f3846 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.020096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969d5b5-a1e6-42ca-9370-cd42bd8f3846 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.032240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] The token cache is being invalidate because project ce0abbc5d60d48ff91da7ee4858a28e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:43.032421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:43.033036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:43.037766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1086/2189] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:42 2022] DELETE /identity/v3/projects/ce0abbc5d60d48ff91da7ee4858a28e2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:43.037766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.037766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:43.083194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7e140-8065-459a-ab99-d5d33dcadd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.084083 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7e140-8065-459a-ab99-d5d33dcadd1e admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.084345 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7e140-8065-459a-ab99-d5d33dcadd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.084687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7e140-8065-459a-ab99-d5d33dcadd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.085522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7e140-8065-459a-ab99-d5d33dcadd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.087381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7e140-8065-459a-ab99-d5d33dcadd1e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.100765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1104/2190] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:43.100765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7e140-8065-459a-ab99-d5d33dcadd1e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.101049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b5a7e140-8065-459a-ab99-d5d33dcadd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:43.116685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7e140-8065-459a-ab99-d5d33dcadd1e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.118714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99999cc-0dca-4fd8-8277-4df1251efcd3 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.121957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2a0b1-480b-4639-a237-a8efca941e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.122575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a0b1-480b-4639-a237-a8efca941e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.122852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a0b1-480b-4639-a237-a8efca941e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.123289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a0b1-480b-4639-a237-a8efca941e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.126405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2a0b1-480b-4639-a237-a8efca941e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.126559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e0b29-25ad-461a-8696-945b9b9d4a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.126931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e0b29-25ad-461a-8696-945b9b9d4a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.127210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e0b29-25ad-461a-8696-945b9b9d4a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.127482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e0b29-25ad-461a-8696-945b9b9d4a42 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.128141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e0b29-25ad-461a-8696-945b9b9d4a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.130067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e0b29-25ad-461a-8696-945b9b9d4a42 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.131112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2a0b1-480b-4639-a237-a8efca941e30 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.144354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1105/2191] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:43.145482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2a0b1-480b-4639-a237-a8efca941e30 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.147628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bfc2a0b1-480b-4639-a237-a8efca941e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:43.163134 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2a0b1-480b-4639-a237-a8efca941e30 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.168523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.169174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.169443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.169707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] PATH_INFO: `/v3/users/aecc60e726324c91b17abc7226aa0153` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.170815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecc60e726324c91b17abc7226aa0153)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.172771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.298788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1087/2192] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:43 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:43.298788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e0b29-25ad-461a-8696-945b9b9d4a42 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.298788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-163e0b29-25ad-461a-8696-945b9b9d4a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:43.311107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e0b29-25ad-461a-8696-945b9b9d4a42 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.316030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f02c-e647-40e0-a8c0-f82781c6c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.317791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f02c-e647-40e0-a8c0-f82781c6c0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.318071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f02c-e647-40e0-a8c0-f82781c6c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.318340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f02c-e647-40e0-a8c0-f82781c6c0fe admin admin] PATH_INFO: `/v3/projects/7107449d30924c1cb7b99f54b1592c88/users/a1d4c5a0ec9a48f5b2bc61c17ad5d879/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.343482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113f02c-e647-40e0-a8c0-f82781c6c0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7107449d30924c1cb7b99f54b1592c88, user_id=a1d4c5a0ec9a48f5b2bc61c17ad5d879, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.346356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113f02c-e647-40e0-a8c0-f82781c6c0fe admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.401307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecc60e726324c91b17abc7226aa0153'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:43.418555 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:43.424383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1088/2193] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:43 2022] PUT /identity/v3/projects/7107449d30924c1cb7b99f54b1592c88/users/a1d4c5a0ec9a48f5b2bc61c17ad5d879/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:43.425240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f02c-e647-40e0-a8c0-f82781c6c0fe admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.471609 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecc60e726324c91b17abc7226aa0153'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:43.479737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecc60e726324c91b17abc7226aa0153'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:43.480416 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecc60e726324c91b17abc7226aa0153'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:43.490686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f02c-e647-40e0-a8c0-f82781c6c0fe admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.493137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecc60e726324c91b17abc7226aa0153'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:43.495769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f831d3f-da61-43f7-8118-346a12f42d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.496452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831d3f-da61-43f7-8118-346a12f42d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.496726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831d3f-da61-43f7-8118-346a12f42d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.496992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831d3f-da61-43f7-8118-346a12f42d87 admin admin] PATH_INFO: `/v3/projects/5b2d61ddc1f14656b7ceb3aeedaf2875/users/dc9f1503e627428f8de0d81dc5e70f15/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.499118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1106/2194] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:43 2022] DELETE /identity/v3/users/aecc60e726324c91b17abc7226aa0153 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:43.500079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.501523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:43.514660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f831d3f-da61-43f7-8118-346a12f42d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2d61ddc1f14656b7ceb3aeedaf2875, user_id=dc9f1503e627428f8de0d81dc5e70f15, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.517764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f831d3f-da61-43f7-8118-346a12f42d87 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.579551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91dd0-3112-457c-b196-811fddb852b0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.593579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dcc33-d556-44e5-87e0-de678ac4f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.594275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dcc33-d556-44e5-87e0-de678ac4f22d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.594585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dcc33-d556-44e5-87e0-de678ac4f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.595137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dcc33-d556-44e5-87e0-de678ac4f22d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.595588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334dcc33-d556-44e5-87e0-de678ac4f22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.597584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334dcc33-d556-44e5-87e0-de678ac4f22d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.608818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1107/2195] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:43.609693 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dcc33-d556-44e5-87e0-de678ac4f22d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.614698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-334dcc33-d556-44e5-87e0-de678ac4f22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:43.626413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dcc33-d556-44e5-87e0-de678ac4f22d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.631257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c029291-13ac-4483-ac5e-f453ee7d6de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.631912 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029291-13ac-4483-ac5e-f453ee7d6de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.632191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029291-13ac-4483-ac5e-f453ee7d6de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.632463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029291-13ac-4483-ac5e-f453ee7d6de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.633361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c029291-13ac-4483-ac5e-f453ee7d6de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.634686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c029291-13ac-4483-ac5e-f453ee7d6de0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.638479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1089/2196] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:43 2022] PUT /identity/v3/projects/5b2d61ddc1f14656b7ceb3aeedaf2875/users/dc9f1503e627428f8de0d81dc5e70f15/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:43.641799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f831d3f-da61-43f7-8118-346a12f42d87 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.648723 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1108/2197] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:43.649565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c029291-13ac-4483-ac5e-f453ee7d6de0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.653268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8c029291-13ac-4483-ac5e-f453ee7d6de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:43.668212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c029291-13ac-4483-ac5e-f453ee7d6de0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.713463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f831d3f-da61-43f7-8118-346a12f42d87 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.719712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d4dd7-9ecf-43ab-b48d-db4a62cb52b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.720416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d4dd7-9ecf-43ab-b48d-db4a62cb52b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.720702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d4dd7-9ecf-43ab-b48d-db4a62cb52b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.720959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d4dd7-9ecf-43ab-b48d-db4a62cb52b8 admin admin] PATH_INFO: `/v3/projects/c93e410292a841daa0156c6b819e4e9b/users/f57b60a6811a46d1ab3dc804279ff921/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.731177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dd8ec-e1eb-42a0-9c5a-fa0e37b05c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.731920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd8ec-e1eb-42a0-9c5a-fa0e37b05c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.732191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd8ec-e1eb-42a0-9c5a-fa0e37b05c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.732520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd8ec-e1eb-42a0-9c5a-fa0e37b05c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.733483 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dd8ec-e1eb-42a0-9c5a-fa0e37b05c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.735190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dd8ec-e1eb-42a0-9c5a-fa0e37b05c08 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.748983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1109/2198] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:43.748983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dd8ec-e1eb-42a0-9c5a-fa0e37b05c08 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.757357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d4dd7-9ecf-43ab-b48d-db4a62cb52b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93e410292a841daa0156c6b819e4e9b, user_id=f57b60a6811a46d1ab3dc804279ff921, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.760393 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dd8ec-e1eb-42a0-9c5a-fa0e37b05c08 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.760892 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d4dd7-9ecf-43ab-b48d-db4a62cb52b8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.765386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549aaa0-a33d-4ed3-8d12-8ee54b08e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.766036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549aaa0-a33d-4ed3-8d12-8ee54b08e776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.766308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549aaa0-a33d-4ed3-8d12-8ee54b08e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.766729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549aaa0-a33d-4ed3-8d12-8ee54b08e776 admin admin] PATH_INFO: `/v3/projects/7107449d30924c1cb7b99f54b1592c88/users/a1d4c5a0ec9a48f5b2bc61c17ad5d879/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.768561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549aaa0-a33d-4ed3-8d12-8ee54b08e776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7107449d30924c1cb7b99f54b1592c88, user_id=a1d4c5a0ec9a48f5b2bc61c17ad5d879, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.771930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549aaa0-a33d-4ed3-8d12-8ee54b08e776 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.784015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1110/2199] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:43 2022] PUT /identity/v3/projects/7107449d30924c1cb7b99f54b1592c88/users/a1d4c5a0ec9a48f5b2bc61c17ad5d879/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:43.793574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549aaa0-a33d-4ed3-8d12-8ee54b08e776 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.853706 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1090/2200] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:43 2022] PUT /identity/v3/projects/c93e410292a841daa0156c6b819e4e9b/users/f57b60a6811a46d1ab3dc804279ff921/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:43.858566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d042e-d412-487b-97ad-b4fffc9c4064 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.858885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d042e-d412-487b-97ad-b4fffc9c4064 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.859222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d042e-d412-487b-97ad-b4fffc9c4064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.874865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549aaa0-a33d-4ed3-8d12-8ee54b08e776 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:43.888789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-540d042e-d412-487b-97ad-b4fffc9c4064 None None] MFA Rules not processed for user `a1d4c5a0ec9a48f5b2bc61c17ad5d879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:43.890022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-540d042e-d412-487b-97ad-b4fffc9c4064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:43.931310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b7d09-4c37-43af-9475-81c8f31d2ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:43.932003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b7d09-4c37-43af-9475-81c8f31d2ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.932282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b7d09-4c37-43af-9475-81c8f31d2ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.932553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b7d09-4c37-43af-9475-81c8f31d2ca0 admin admin] PATH_INFO: `/v3/projects/5b2d61ddc1f14656b7ceb3aeedaf2875/users/dc9f1503e627428f8de0d81dc5e70f15/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.934543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b7d09-4c37-43af-9475-81c8f31d2ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2d61ddc1f14656b7ceb3aeedaf2875, user_id=dc9f1503e627428f8de0d81dc5e70f15, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:43.937394 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b7d09-4c37-43af-9475-81c8f31d2ca0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:43.948145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1111/2201] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:43 2022] PUT /identity/v3/projects/5b2d61ddc1f14656b7ceb3aeedaf2875/users/dc9f1503e627428f8de0d81dc5e70f15/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:43.948733 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b7d09-4c37-43af-9475-81c8f31d2ca0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:43.960158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1091/2202] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:43.961413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cc059-d606-4093-9f21-c1d8902809a4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:43.961701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cc059-d606-4093-9f21-c1d8902809a4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:43.961978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cc059-d606-4093-9f21-c1d8902809a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:43.990109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f45cc059-d606-4093-9f21-c1d8902809a4 None None] MFA Rules not processed for user `dc9f1503e627428f8de0d81dc5e70f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:43.994237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f45cc059-d606-4093-9f21-c1d8902809a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:44.022115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:44.024331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b7d09-4c37-43af-9475-81c8f31d2ca0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.029029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879dc30-c4bc-4635-a436-16772b59b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.029644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879dc30-c4bc-4635-a436-16772b59b1df admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.029924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879dc30-c4bc-4635-a436-16772b59b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.030234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879dc30-c4bc-4635-a436-16772b59b1df admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.030868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879dc30-c4bc-4635-a436-16772b59b1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:44.032511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879dc30-c4bc-4635-a436-16772b59b1df admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:44.042741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1112/2203] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:44.043637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879dc30-c4bc-4635-a436-16772b59b1df admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:44.052647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d879dc30-c4bc-4635-a436-16772b59b1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:44.067348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1092/2204] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:44.068639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cc059-d606-4093-9f21-c1d8902809a4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:44.070229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f45cc059-d606-4093-9f21-c1d8902809a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:44.083581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cc059-d606-4093-9f21-c1d8902809a4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.089286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.089926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.090205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.090484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] PATH_INFO: `/v3/projects/07c247241a59497cad7f332a53098968` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.092264 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c247241a59497cad7f332a53098968)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:44.094257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:44.107824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879dc30-c4bc-4635-a436-16772b59b1df admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.111647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038308a6-5ca3-49bc-ab46-3fe2f5c0db3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.112304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038308a6-5ca3-49bc-ab46-3fe2f5c0db3f service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.112585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038308a6-5ca3-49bc-ab46-3fe2f5c0db3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.112861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038308a6-5ca3-49bc-ab46-3fe2f5c0db3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.114613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-038308a6-5ca3-49bc-ab46-3fe2f5c0db3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:44.174441 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038308a6-5ca3-49bc-ab46-3fe2f5c0db3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:44.175877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038308a6-5ca3-49bc-ab46-3fe2f5c0db3f service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:44.185007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1113/2205] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:44.185641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038308a6-5ca3-49bc-ab46-3fe2f5c0db3f service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:44.197104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038308a6-5ca3-49bc-ab46-3fe2f5c0db3f service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.201967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10961dc0-6d7b-4b9a-8948-7f2ef9fa49f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.202633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961dc0-6d7b-4b9a-8948-7f2ef9fa49f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.203041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961dc0-6d7b-4b9a-8948-7f2ef9fa49f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.203319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961dc0-6d7b-4b9a-8948-7f2ef9fa49f9 admin admin] PATH_INFO: `/v3/projects/c93e410292a841daa0156c6b819e4e9b/users/f57b60a6811a46d1ab3dc804279ff921/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.205317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10961dc0-6d7b-4b9a-8948-7f2ef9fa49f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93e410292a841daa0156c6b819e4e9b, user_id=f57b60a6811a46d1ab3dc804279ff921, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:44.208123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10961dc0-6d7b-4b9a-8948-7f2ef9fa49f9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:44.220459 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1114/2206] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:44 2022] PUT /identity/v3/projects/c93e410292a841daa0156c6b819e4e9b/users/f57b60a6811a46d1ab3dc804279ff921/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:44.221245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10961dc0-6d7b-4b9a-8948-7f2ef9fa49f9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:44.228813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-10961dc0-6d7b-4b9a-8948-7f2ef9fa49f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:44.243154 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c247241a59497cad7f332a53098968', 'request_id': 'req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:44.249084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c247241a59497cad7f332a53098968', 'request_id': 'req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:44.256498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c247241a59497cad7f332a53098968', 'request_id': 'req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:44.301260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10961dc0-6d7b-4b9a-8948-7f2ef9fa49f9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.326731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] The token cache is being invalidate because project 07c247241a59497cad7f332a53098968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:44.327679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:44.328420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-109ffa9c-2f3b-4dac-80de-c1dc93e94d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:44.330234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1093/2207] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:44 2022] DELETE /identity/v3/projects/07c247241a59497cad7f332a53098968 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:44.331294 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518cc3d-7e60-4fb3-9efd-cb64891d56a9 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.331576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518cc3d-7e60-4fb3-9efd-cb64891d56a9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.331851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518cc3d-7e60-4fb3-9efd-cb64891d56a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.364678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e518cc3d-7e60-4fb3-9efd-cb64891d56a9 None None] MFA Rules not processed for user `f57b60a6811a46d1ab3dc804279ff921`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:44.367401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e518cc3d-7e60-4fb3-9efd-cb64891d56a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:44.384856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9632-0bcb-4408-b157-a5117943400f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.384856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9632-0bcb-4408-b157-a5117943400f service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.384856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9632-0bcb-4408-b157-a5117943400f service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.385161 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9632-0bcb-4408-b157-a5117943400f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.386724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2e7c9632-0bcb-4408-b157-a5117943400f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:44.440671 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1094/2208] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:44.441872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8da0-8e94-44a7-844d-04ef0d490b79 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.442214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8da0-8e94-44a7-844d-04ef0d490b79 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.442553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8da0-8e94-44a7-844d-04ef0d490b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.454366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c9632-0bcb-4408-b157-a5117943400f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:44.455873 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c9632-0bcb-4408-b157-a5117943400f service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:44.464223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7a1b8da0-8e94-44a7-844d-04ef0d490b79 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:44.465717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7a1b8da0-8e94-44a7-844d-04ef0d490b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:44.467233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1115/2209] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:44.529731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1095/2210] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:44.538377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c565b-4434-42a6-a2d5-6b6381983b29 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.538665 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c565b-4434-42a6-a2d5-6b6381983b29 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.538942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c565b-4434-42a6-a2d5-6b6381983b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.559156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f55c565b-4434-42a6-a2d5-6b6381983b29 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:44.560450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f55c565b-4434-42a6-a2d5-6b6381983b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:44.569181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1116/2211] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:44.573521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8da0-8e94-44a7-844d-04ef0d490b79 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:44.583042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8da0-8e94-44a7-844d-04ef0d490b79 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.587839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dda20-201a-4254-b03e-372674b47cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.588476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dda20-201a-4254-b03e-372674b47cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.588755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dda20-201a-4254-b03e-372674b47cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.589093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dda20-201a-4254-b03e-372674b47cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.589736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dda20-201a-4254-b03e-372674b47cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:44.590034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dda20-201a-4254-b03e-372674b47cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:44.591663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dda20-201a-4254-b03e-372674b47cd8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:44.607203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1096/2212] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:44.614206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c565b-4434-42a6-a2d5-6b6381983b29 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:44.624225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c565b-4434-42a6-a2d5-6b6381983b29 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.629005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ba69-3026-4709-b9a0-2b2445b71732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.629768 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ba69-3026-4709-b9a0-2b2445b71732 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.629917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ba69-3026-4709-b9a0-2b2445b71732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.630171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ba69-3026-4709-b9a0-2b2445b71732 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.631343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ba69-3026-4709-b9a0-2b2445b71732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:44.633296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ba69-3026-4709-b9a0-2b2445b71732 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:44.649169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:44.724124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1117/2213] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:44 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:44.725935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dda20-201a-4254-b03e-372674b47cd8 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:44.736058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dda20-201a-4254-b03e-372674b47cd8 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.793093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1004f67-607b-4503-bb0d-ada5c034d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.793696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004f67-607b-4503-bb0d-ada5c034d272 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.794180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004f67-607b-4503-bb0d-ada5c034d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.794453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004f67-607b-4503-bb0d-ada5c034d272 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.795082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1004f67-607b-4503-bb0d-ada5c034d272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:44.797075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1004f67-607b-4503-bb0d-ada5c034d272 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:44.891712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1097/2214] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:44 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:44.895700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ba69-3026-4709-b9a0-2b2445b71732 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:44.906206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ba69-3026-4709-b9a0-2b2445b71732 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.911559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc631453-72c0-4c0b-aab9-6497feb9c5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.912644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc631453-72c0-4c0b-aab9-6497feb9c5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.917598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc631453-72c0-4c0b-aab9-6497feb9c5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.917598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc631453-72c0-4c0b-aab9-6497feb9c5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.917598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc631453-72c0-4c0b-aab9-6497feb9c5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:44.917598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc631453-72c0-4c0b-aab9-6497feb9c5d4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:44.926717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1118/2215] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:44.931910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1004f67-607b-4503-bb0d-ada5c034d272 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:44.942081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1004f67-607b-4503-bb0d-ada5c034d272 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.946867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac1fb-9e04-4542-afc7-bbda77df0bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.947456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac1fb-9e04-4542-afc7-bbda77df0bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.947728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac1fb-9e04-4542-afc7-bbda77df0bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.948029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac1fb-9e04-4542-afc7-bbda77df0bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:44.948689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ac1fb-9e04-4542-afc7-bbda77df0bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:44.950392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ac1fb-9e04-4542-afc7-bbda77df0bf3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:44.961203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1098/2216] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:44.965343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc631453-72c0-4c0b-aab9-6497feb9c5d4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:44.975916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc631453-72c0-4c0b-aab9-6497feb9c5d4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:44.989136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04738ff9-6623-4f34-b393-ee57b659f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:44.990839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738ff9-6623-4f34-b393-ee57b659f415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:44.995366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738ff9-6623-4f34-b393-ee57b659f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:44.995366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738ff9-6623-4f34-b393-ee57b659f415 admin admin] PATH_INFO: `/v3/projects/eabc2edece814d93bd61a9e6b51d8da7/users/e9a929eb07974c8e822aa08150e4b13d/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.007616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04738ff9-6623-4f34-b393-ee57b659f415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eabc2edece814d93bd61a9e6b51d8da7, user_id=e9a929eb07974c8e822aa08150e4b13d, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:45.010409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04738ff9-6623-4f34-b393-ee57b659f415 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:45.015203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac1fb-9e04-4542-afc7-bbda77df0bf3 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:45.016920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d22ac1fb-9e04-4542-afc7-bbda77df0bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:45.072295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac1fb-9e04-4542-afc7-bbda77df0bf3 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:45.075943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f2620-07c8-46e4-9459-9bfe4777d06f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:45.076542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f2620-07c8-46e4-9459-9bfe4777d06f service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:45.076815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f2620-07c8-46e4-9459-9bfe4777d06f service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:45.077081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f2620-07c8-46e4-9459-9bfe4777d06f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.107591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1119/2217] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:44 2022] PUT /identity/v3/projects/eabc2edece814d93bd61a9e6b51d8da7/users/e9a929eb07974c8e822aa08150e4b13d/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:45.119089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759bbaf-2f1d-4a29-b361-43331372666c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:45.119369 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759bbaf-2f1d-4a29-b361-43331372666c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:45.119693 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759bbaf-2f1d-4a29-b361-43331372666c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.155203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4759bbaf-2f1d-4a29-b361-43331372666c None None] MFA Rules not processed for user `e9a929eb07974c8e822aa08150e4b13d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:45.157454 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4759bbaf-2f1d-4a29-b361-43331372666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:45.163903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f2620-07c8-46e4-9459-9bfe4777d06f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:45.167466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f2620-07c8-46e4-9459-9bfe4777d06f service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:45.175928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1099/2218] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:45.243151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1120/2219] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:45.247553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f2620-07c8-46e4-9459-9bfe4777d06f service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:45.259381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f2620-07c8-46e4-9459-9bfe4777d06f service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:45.324328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:45.335926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a18b0e-9b7a-45d7-8f17-2a3d6b172b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:45.336658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18b0e-9b7a-45d7-8f17-2a3d6b172b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:45.337039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18b0e-9b7a-45d7-8f17-2a3d6b172b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:45.337411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18b0e-9b7a-45d7-8f17-2a3d6b172b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.338151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a18b0e-9b7a-45d7-8f17-2a3d6b172b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:45.340437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a18b0e-9b7a-45d7-8f17-2a3d6b172b7e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:45.371045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759bbaf-2f1d-4a29-b361-43331372666c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:45.372516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4759bbaf-2f1d-4a29-b361-43331372666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:45.388352 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759bbaf-2f1d-4a29-b361-43331372666c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:45.398719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:45.398719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:45.398719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:45.398719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] PATH_INFO: `/v3/users/6a5d8a11dbfb4ea5bf0f4671b6fa496f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.399135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5d8a11dbfb4ea5bf0f4671b6fa496f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:45.399135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:45.489290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1100/2220] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:45 2022] POST /identity/v3/projects => generated 367 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:45.489290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a18b0e-9b7a-45d7-8f17-2a3d6b172b7e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:45.490944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-55a18b0e-9b7a-45d7-8f17-2a3d6b172b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:45.552873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a18b0e-9b7a-45d7-8f17-2a3d6b172b7e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:45.556573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b16b4-e39a-497d-be94-91cb27c273bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:45.557206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b16b4-e39a-497d-be94-91cb27c273bc service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:45.557479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b16b4-e39a-497d-be94-91cb27c273bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:45.557745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b16b4-e39a-497d-be94-91cb27c273bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.559451 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-aa6b16b4-e39a-497d-be94-91cb27c273bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:45.625730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b16b4-e39a-497d-be94-91cb27c273bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:45.627180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b16b4-e39a-497d-be94-91cb27c273bc service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:45.629747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5d8a11dbfb4ea5bf0f4671b6fa496f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:45.636865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1101/2221] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:45.637687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b16b4-e39a-497d-be94-91cb27c273bc service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:45.696074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5d8a11dbfb4ea5bf0f4671b6fa496f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:45.699120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b16b4-e39a-497d-be94-91cb27c273bc service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:45.703778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a6aed-23d8-4718-ba1b-b6b93c1839f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:45.703932 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5d8a11dbfb4ea5bf0f4671b6fa496f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:45.704407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a6aed-23d8-4718-ba1b-b6b93c1839f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:45.704531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5d8a11dbfb4ea5bf0f4671b6fa496f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:45.704680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a6aed-23d8-4718-ba1b-b6b93c1839f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:45.704951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a6aed-23d8-4718-ba1b-b6b93c1839f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.705695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a6aed-23d8-4718-ba1b-b6b93c1839f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:45.707847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a6aed-23d8-4718-ba1b-b6b93c1839f7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:45.718245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-97ba409f-8b8f-4948-9e3b-4ce8e2929687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5d8a11dbfb4ea5bf0f4671b6fa496f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:45.725698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1121/2222] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:45 2022] DELETE /identity/v3/users/6a5d8a11dbfb4ea5bf0f4671b6fa496f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:45.730119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fa60f-3082-4aa8-a179-d1eb8bbdb545 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:45.730424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fa60f-3082-4aa8-a179-d1eb8bbdb545 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:45.730918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fa60f-3082-4aa8-a179-d1eb8bbdb545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.750658 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-529fa60f-3082-4aa8-a179-d1eb8bbdb545 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:45.751816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-529fa60f-3082-4aa8-a179-d1eb8bbdb545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:45.783591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1102/2223] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:45 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:45.788727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a6aed-23d8-4718-ba1b-b6b93c1839f7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:45.790734 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-336a6aed-23d8-4718-ba1b-b6b93c1839f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:45.806845 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a6aed-23d8-4718-ba1b-b6b93c1839f7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:45.812961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2f83d-9f32-4897-ae29-03659b13e1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:45.813568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2f83d-9f32-4897-ae29-03659b13e1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:45.813846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2f83d-9f32-4897-ae29-03659b13e1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:45.814120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2f83d-9f32-4897-ae29-03659b13e1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.814276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1122/2224] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:45.817779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2f83d-9f32-4897-ae29-03659b13e1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:45.817779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2f83d-9f32-4897-ae29-03659b13e1c8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:45.825364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fa60f-3082-4aa8-a179-d1eb8bbdb545 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:45.826964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-529fa60f-3082-4aa8-a179-d1eb8bbdb545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:45.827919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1103/2225] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:45.831792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2f83d-9f32-4897-ae29-03659b13e1c8 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:45.842800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2f83d-9f32-4897-ae29-03659b13e1c8 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:45.848659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e777b6-6940-4adb-bff1-7b1dffdcca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:45.850174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e777b6-6940-4adb-bff1-7b1dffdcca39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:45.850458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e777b6-6940-4adb-bff1-7b1dffdcca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:45.850736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e777b6-6940-4adb-bff1-7b1dffdcca39 admin admin] PATH_INFO: `/v3/projects/018c18ba0ecc4a0eb91258b9a8137442/users/68e5c5c46d6545babbbb9409f0e126d4/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.866594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e777b6-6940-4adb-bff1-7b1dffdcca39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018c18ba0ecc4a0eb91258b9a8137442, user_id=68e5c5c46d6545babbbb9409f0e126d4, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:45.869624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e777b6-6940-4adb-bff1-7b1dffdcca39 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:45.887159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fa60f-3082-4aa8-a179-d1eb8bbdb545 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:45.890871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b385-533e-4491-9735-2d716112cdb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:45.891469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b385-533e-4491-9735-2d716112cdb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:45.891749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b385-533e-4491-9735-2d716112cdb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:45.892071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b385-533e-4491-9735-2d716112cdb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:45.901479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528b385-533e-4491-9735-2d716112cdb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:45.902921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528b385-533e-4491-9735-2d716112cdb3 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:45.913188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1123/2226] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:45.928598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:45.937362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1104/2227] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:45 2022] PUT /identity/v3/projects/018c18ba0ecc4a0eb91258b9a8137442/users/68e5c5c46d6545babbbb9409f0e126d4/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:45.942519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b385-533e-4491-9735-2d716112cdb3 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:45.963650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b385-533e-4491-9735-2d716112cdb3 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:46.043577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aea289-60a3-469a-8aa1-af1401866f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:46.044233 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea289-60a3-469a-8aa1-af1401866f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:46.044513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea289-60a3-469a-8aa1-af1401866f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:46.044786 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea289-60a3-469a-8aa1-af1401866f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:46.045421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aea289-60a3-469a-8aa1-af1401866f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:46.047049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aea289-60a3-469a-8aa1-af1401866f44 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:46.060330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1124/2228] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:46.061559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e777b6-6940-4adb-bff1-7b1dffdcca39 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:46.072544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e777b6-6940-4adb-bff1-7b1dffdcca39 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:46.077516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f27a2-1055-438e-993f-83a8a61e6102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:46.078365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f27a2-1055-438e-993f-83a8a61e6102 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:46.078710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f27a2-1055-438e-993f-83a8a61e6102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:46.079117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f27a2-1055-438e-993f-83a8a61e6102 admin admin] PATH_INFO: `/v3/projects/018c18ba0ecc4a0eb91258b9a8137442/users/68e5c5c46d6545babbbb9409f0e126d4/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:46.081101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f27a2-1055-438e-993f-83a8a61e6102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018c18ba0ecc4a0eb91258b9a8137442, user_id=68e5c5c46d6545babbbb9409f0e126d4, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:46.084379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f27a2-1055-438e-993f-83a8a61e6102 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:46.103915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1105/2229] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:46 2022] PUT /identity/v3/projects/018c18ba0ecc4a0eb91258b9a8137442/users/68e5c5c46d6545babbbb9409f0e126d4/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:46.107142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b1b4a-04aa-4e61-ba66-f77c846fe773 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:46.107473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b1b4a-04aa-4e61-ba66-f77c846fe773 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:46.107643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b1b4a-04aa-4e61-ba66-f77c846fe773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:46.141446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-169b1b4a-04aa-4e61-ba66-f77c846fe773 None None] MFA Rules not processed for user `68e5c5c46d6545babbbb9409f0e126d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:46.142668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-169b1b4a-04aa-4e61-ba66-f77c846fe773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:46.227605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1125/2230] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:46.235102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f27a2-1055-438e-993f-83a8a61e6102 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:46.237501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a50f27a2-1055-438e-993f-83a8a61e6102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:46.307835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f27a2-1055-438e-993f-83a8a61e6102 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:46.311729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9efa9-be4d-405a-b321-c68fc1679d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:46.312379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9efa9-be4d-405a-b321-c68fc1679d7f service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:46.312649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9efa9-be4d-405a-b321-c68fc1679d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:46.312923 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9efa9-be4d-405a-b321-c68fc1679d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:46.322455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9efa9-be4d-405a-b321-c68fc1679d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:46.323875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9efa9-be4d-405a-b321-c68fc1679d7f service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:46.333397 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1106/2231] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:46.406960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b1b4a-04aa-4e61-ba66-f77c846fe773 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:46.408501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-169b1b4a-04aa-4e61-ba66-f77c846fe773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:46.476582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:46.513121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b1b4a-04aa-4e61-ba66-f77c846fe773 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:46.518065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:46.518703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:46.518981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:46.519261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] PATH_INFO: `/v3/projects/d1239d8ae3584e098b25a5314ee6a0e0` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:46.520486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1239d8ae3584e098b25a5314ee6a0e0)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:46.522977 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:46.588229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9efa9-be4d-405a-b321-c68fc1679d7f service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:46.597202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9efa9-be4d-405a-b321-c68fc1679d7f service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:46.600962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c329c-3fb1-4b75-8752-b9192c33a7af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:46.601558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c329c-3fb1-4b75-8752-b9192c33a7af service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:46.601836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c329c-3fb1-4b75-8752-b9192c33a7af service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:46.602205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c329c-3fb1-4b75-8752-b9192c33a7af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:46.604023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-661c329c-3fb1-4b75-8752-b9192c33a7af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:46.665232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c329c-3fb1-4b75-8752-b9192c33a7af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:46.666665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c329c-3fb1-4b75-8752-b9192c33a7af service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:46.667159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1239d8ae3584e098b25a5314ee6a0e0', 'request_id': 'req-2e9dbf39-d22b-411a-a52e-9ec704336f75'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:46.674203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1239d8ae3584e098b25a5314ee6a0e0', 'request_id': 'req-2e9dbf39-d22b-411a-a52e-9ec704336f75'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:46.676483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1107/2232] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:46.682881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1239d8ae3584e098b25a5314ee6a0e0', 'request_id': 'req-2e9dbf39-d22b-411a-a52e-9ec704336f75'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:46.763971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] The token cache is being invalidate because project d1239d8ae3584e098b25a5314ee6a0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:46.764246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:46.766660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:46.766660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1126/2233] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:46 2022] DELETE /identity/v3/projects/d1239d8ae3584e098b25a5314ee6a0e0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:46.776314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c329c-3fb1-4b75-8752-b9192c33a7af service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:46.776811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:46.778261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:46.787517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c329c-3fb1-4b75-8752-b9192c33a7af service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:46.839496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dbf39-d22b-411a-a52e-9ec704336f75 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:46.852814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0571-effd-453c-bd60-39b2756f900b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:46.852814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0571-effd-453c-bd60-39b2756f900b service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:46.852814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0571-effd-453c-bd60-39b2756f900b service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:46.852814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0571-effd-453c-bd60-39b2756f900b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:46.853274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ce3f0571-effd-453c-bd60-39b2756f900b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:46.853372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:46.853372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:46.853372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:46.853372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] PATH_INFO: `/v3/users/40a9e5ae226544638a1cf19e935a4274` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:46.853684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a9e5ae226544638a1cf19e935a4274)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:46.853684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:46.905245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f0571-effd-453c-bd60-39b2756f900b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:46.906809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f0571-effd-453c-bd60-39b2756f900b service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:46.917341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1127/2234] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:47.080844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a9e5ae226544638a1cf19e935a4274'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:47.081499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a9e5ae226544638a1cf19e935a4274'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:47.093236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a9e5ae226544638a1cf19e935a4274'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:47.101308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a9e5ae226544638a1cf19e935a4274'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:47.148141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:47.170625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a9e5ae226544638a1cf19e935a4274'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:47.178079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1108/2235] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:46 2022] DELETE /identity/v3/users/40a9e5ae226544638a1cf19e935a4274 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:47.377259 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:47.667700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0571-effd-453c-bd60-39b2756f900b service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:47.669942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ce3f0571-effd-453c-bd60-39b2756f900b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:47.685269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0571-effd-453c-bd60-39b2756f900b service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:47.743353 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:47.744023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:47.744307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:47.744584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] PATH_INFO: `/v3/projects/e94fe95d7bcc4f37997b17f1ee0c8d5f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:47.745817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94fe95d7bcc4f37997b17f1ee0c8d5f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:47.748844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:47.897180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94fe95d7bcc4f37997b17f1ee0c8d5f', 'request_id': 'req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:47.908137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94fe95d7bcc4f37997b17f1ee0c8d5f', 'request_id': 'req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:47.908905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94fe95d7bcc4f37997b17f1ee0c8d5f', 'request_id': 'req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:48.004380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] The token cache is being invalidate because project e94fe95d7bcc4f37997b17f1ee0c8d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:48.004559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:48.013034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:48.014952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1128/2236] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:47 2022] DELETE /identity/v3/projects/e94fe95d7bcc4f37997b17f1ee0c8d5f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:48.018780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:48.020744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:48.034663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b248b-e98b-4051-9e3f-06a60baf26e9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:48.095447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:48.096107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:48.096379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:48.096659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] PATH_INFO: `/v3/users/b9670322e9b747048bdfc28ea43ed996` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:48.097800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9670322e9b747048bdfc28ea43ed996)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:48.100487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:48.344759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9670322e9b747048bdfc28ea43ed996'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:48.345409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9670322e9b747048bdfc28ea43ed996'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:48.358346 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9670322e9b747048bdfc28ea43ed996'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:48.361028 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:48.367633 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9670322e9b747048bdfc28ea43ed996'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:48.511958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9670322e9b747048bdfc28ea43ed996'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:48.520728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1109/2237] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:48 2022] DELETE /identity/v3/users/b9670322e9b747048bdfc28ea43ed996 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:48.525378 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:48.851848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:48.853347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:48.917308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e418-6dc7-43fa-99ec-1dbdf77279f8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:48.989051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8149eb-9a3b-423c-a881-58188c3e132a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:48.990664 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8149eb-9a3b-423c-a881-58188c3e132a service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:48.991121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8149eb-9a3b-423c-a881-58188c3e132a service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:48.991599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8149eb-9a3b-423c-a881-58188c3e132a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:48.993942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4d8149eb-9a3b-423c-a881-58188c3e132a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:49.030851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:49.032826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:49.128933 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8149eb-9a3b-423c-a881-58188c3e132a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:49.132089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8149eb-9a3b-423c-a881-58188c3e132a service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:49.142591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1129/2238] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:49.148683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04242ca-c031-40e7-a85d-f6a30ffd59bb admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:49.154744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:49.155540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:49.155988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:49.156484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] PATH_INFO: `/v3/projects/90e9f787ae214541bdc3b00b89a95d49` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:49.157747 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e9f787ae214541bdc3b00b89a95d49)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:49.170842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:49.188631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:49.315468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e9f787ae214541bdc3b00b89a95d49', 'request_id': 'req-e97d8618-48da-4daa-9a24-fbd7b8270b93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:49.320880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e9f787ae214541bdc3b00b89a95d49', 'request_id': 'req-e97d8618-48da-4daa-9a24-fbd7b8270b93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:49.327042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e9f787ae214541bdc3b00b89a95d49', 'request_id': 'req-e97d8618-48da-4daa-9a24-fbd7b8270b93'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:49.478018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] The token cache is being invalidate because project 90e9f787ae214541bdc3b00b89a95d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:49.478925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:49.478925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e97d8618-48da-4daa-9a24-fbd7b8270b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:49.480742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1110/2239] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:49 2022] DELETE /identity/v3/projects/90e9f787ae214541bdc3b00b89a95d49 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:49.486444 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e744b-d616-4d05-816d-77dd4ba263a8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:49.486739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e744b-d616-4d05-816d-77dd4ba263a8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:49.487015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e744b-d616-4d05-816d-77dd4ba263a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:49.507752 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-155e744b-d616-4d05-816d-77dd4ba263a8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:49.509008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-155e744b-d616-4d05-816d-77dd4ba263a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:49.569694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1130/2240] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:49.577540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3b8a6-cd37-455c-aec2-fc98e858d59f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:49.577823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3b8a6-cd37-455c-aec2-fc98e858d59f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:49.578127 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3b8a6-cd37-455c-aec2-fc98e858d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:49.598728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-38a3b8a6-cd37-455c-aec2-fc98e858d59f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:49.600546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-38a3b8a6-cd37-455c-aec2-fc98e858d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:49.608612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1111/2241] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:49.613243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e744b-d616-4d05-816d-77dd4ba263a8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:49.623359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e744b-d616-4d05-816d-77dd4ba263a8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:49.628181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209b21-0baa-4136-9ae9-ed360de05d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:49.628783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209b21-0baa-4136-9ae9-ed360de05d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:49.629056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209b21-0baa-4136-9ae9-ed360de05d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:49.629323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209b21-0baa-4136-9ae9-ed360de05d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:49.630010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f209b21-0baa-4136-9ae9-ed360de05d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:49.630336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f209b21-0baa-4136-9ae9-ed360de05d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:49.632239 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f209b21-0baa-4136-9ae9-ed360de05d70 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:49.644075 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1131/2242] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:32:49.649051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3b8a6-cd37-455c-aec2-fc98e858d59f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:49.658487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3b8a6-cd37-455c-aec2-fc98e858d59f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:49.663606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ae33-40c4-4090-b12d-ed070bfd9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:49.664252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ae33-40c4-4090-b12d-ed070bfd9401 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:49.664563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ae33-40c4-4090-b12d-ed070bfd9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:49.664834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ae33-40c4-4090-b12d-ed070bfd9401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:49.665460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9ae33-40c4-4090-b12d-ed070bfd9401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:49.667358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9ae33-40c4-4090-b12d-ed070bfd9401 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:49.764952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:49.772829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1112/2243] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:49 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:49.775975 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209b21-0baa-4136-9ae9-ed360de05d70 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:49.786021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209b21-0baa-4136-9ae9-ed360de05d70 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:49.842415 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e3809-27d5-4665-adac-90e290a4e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:49.843028 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3809-27d5-4665-adac-90e290a4e64f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:49.843304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3809-27d5-4665-adac-90e290a4e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:49.843574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3809-27d5-4665-adac-90e290a4e64f admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:49.844234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e3809-27d5-4665-adac-90e290a4e64f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:49.846157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e3809-27d5-4665-adac-90e290a4e64f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:49.961217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1132/2244] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:49 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:49.963145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ae33-40c4-4090-b12d-ed070bfd9401 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:49.973564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ae33-40c4-4090-b12d-ed070bfd9401 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:49.978190 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e7570-cfa1-4570-a53f-4939172a9a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:49.978778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e7570-cfa1-4570-a53f-4939172a9a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:49.979052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e7570-cfa1-4570-a53f-4939172a9a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:49.979317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e7570-cfa1-4570-a53f-4939172a9a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:49.979979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e7570-cfa1-4570-a53f-4939172a9a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:49.981674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e7570-cfa1-4570-a53f-4939172a9a4f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:49.995428 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1113/2245] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:49.999014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e3809-27d5-4665-adac-90e290a4e64f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:50.009952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e3809-27d5-4665-adac-90e290a4e64f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:50.015034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd274348-bbb1-4501-b254-e72f6f3f7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:50.015636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274348-bbb1-4501-b254-e72f6f3f7fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:50.015936 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274348-bbb1-4501-b254-e72f6f3f7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:50.016212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274348-bbb1-4501-b254-e72f6f3f7fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:50.016932 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd274348-bbb1-4501-b254-e72f6f3f7fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:50.018656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd274348-bbb1-4501-b254-e72f6f3f7fbf admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:50.030332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1133/2246] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:50.034667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e7570-cfa1-4570-a53f-4939172a9a4f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:50.045077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e7570-cfa1-4570-a53f-4939172a9a4f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:50.050043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8df3eb-770a-4c46-9f5f-eace92979167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:50.050699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df3eb-770a-4c46-9f5f-eace92979167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:50.050974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df3eb-770a-4c46-9f5f-eace92979167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:50.051247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df3eb-770a-4c46-9f5f-eace92979167 admin admin] PATH_INFO: `/v3/projects/a81f6d8800534947a1810d9675d88bb3/users/0d3f8698de174d9d9839681a23441cb2/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:50.066347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8df3eb-770a-4c46-9f5f-eace92979167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81f6d8800534947a1810d9675d88bb3, user_id=0d3f8698de174d9d9839681a23441cb2, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:50.069654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8df3eb-770a-4c46-9f5f-eace92979167 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:50.107592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:50.169603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1114/2247] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:32:50 2022] PUT /identity/v3/projects/a81f6d8800534947a1810d9675d88bb3/users/0d3f8698de174d9d9839681a23441cb2/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:50.180054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe137dfa-ca49-489c-a0c7-d4488b1d1349 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:50.180341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe137dfa-ca49-489c-a0c7-d4488b1d1349 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:50.180617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe137dfa-ca49-489c-a0c7-d4488b1d1349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:50.211306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-fe137dfa-ca49-489c-a0c7-d4488b1d1349 None None] MFA Rules not processed for user `0d3f8698de174d9d9839681a23441cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:50.212706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fe137dfa-ca49-489c-a0c7-d4488b1d1349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:50.280122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1134/2248] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:50.292787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8df3eb-770a-4c46-9f5f-eace92979167 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:50.294714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-db8df3eb-770a-4c46-9f5f-eace92979167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:50.379545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8df3eb-770a-4c46-9f5f-eace92979167 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:50.383844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041d611-9664-49cf-947a-e65f3da05170 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6267b159204df7af8a4f84d227f88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:50.384409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041d611-9664-49cf-947a-e65f3da05170 service glance] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:50.384689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041d611-9664-49cf-947a-e65f3da05170 service glance] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:50.384948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041d611-9664-49cf-947a-e65f3da05170 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:50.393117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041d611-9664-49cf-947a-e65f3da05170 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:50.394585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041d611-9664-49cf-947a-e65f3da05170 service glance] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:50.403257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1115/2249] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:51.084397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:51.308766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:51.707266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe137dfa-ca49-489c-a0c7-d4488b1d1349 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:51.709447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fe137dfa-ca49-489c-a0c7-d4488b1d1349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:51.767707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe137dfa-ca49-489c-a0c7-d4488b1d1349 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:51.771859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75c19d-6052-4a40-a2e3-a0c0c96ee023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:51.772497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75c19d-6052-4a40-a2e3-a0c0c96ee023 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:51.772796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75c19d-6052-4a40-a2e3-a0c0c96ee023 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:51.773210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75c19d-6052-4a40-a2e3-a0c0c96ee023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:51.774949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9b75c19d-6052-4a40-a2e3-a0c0c96ee023 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:51.839738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75c19d-6052-4a40-a2e3-a0c0c96ee023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:51.841213 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75c19d-6052-4a40-a2e3-a0c0c96ee023 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:51.850754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1135/2250] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:52.165354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:52.258833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041d611-9664-49cf-947a-e65f3da05170 service glance] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:52.260334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a041d611-9664-49cf-947a-e65f3da05170 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:52.272658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041d611-9664-49cf-947a-e65f3da05170 service glance] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:52.277055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349e453-3089-42e4-8f44-e2ce83c2d898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:52.277679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349e453-3089-42e4-8f44-e2ce83c2d898 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:52.282326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349e453-3089-42e4-8f44-e2ce83c2d898 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:52.282326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349e453-3089-42e4-8f44-e2ce83c2d898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:52.282326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6349e453-3089-42e4-8f44-e2ce83c2d898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:52.304226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:52.349995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349e453-3089-42e4-8f44-e2ce83c2d898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:52.351469 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349e453-3089-42e4-8f44-e2ce83c2d898 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:52.361380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1116/2251] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:53.203421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:53.314452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:54.342552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:54.559789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:55.439223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:55.725859 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:56.285597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:56.306998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75c19d-6052-4a40-a2e3-a0c0c96ee023 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:56.308580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9b75c19d-6052-4a40-a2e3-a0c0c96ee023 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:56.373523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75c19d-6052-4a40-a2e3-a0c0c96ee023 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:56.378319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:56.378957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:56.379228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:56.379498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] PATH_INFO: `/v3/users/e9a929eb07974c8e822aa08150e4b13d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:56.380688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a929eb07974c8e822aa08150e4b13d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:56.382882 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:56.553936 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349e453-3089-42e4-8f44-e2ce83c2d898 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:56.555267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6349e453-3089-42e4-8f44-e2ce83c2d898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:56.568450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349e453-3089-42e4-8f44-e2ce83c2d898 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:56.573789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:56.574563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:56.574848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:56.575296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] PATH_INFO: `/v3/users/39409ecabf674a8fb3b973b126f0e1a7` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:56.576475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=39409ecabf674a8fb3b973b126f0e1a7)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:56.588185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:56.588316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a929eb07974c8e822aa08150e4b13d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:56.690370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a929eb07974c8e822aa08150e4b13d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:56.698676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a929eb07974c8e822aa08150e4b13d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:56.699335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a929eb07974c8e822aa08150e4b13d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:56.711624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-48336cfd-60e0-45c7-8fa7-e762a4f784b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a929eb07974c8e822aa08150e4b13d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:56.717587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1136/2252] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:56 2022] DELETE /identity/v3/users/e9a929eb07974c8e822aa08150e4b13d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:56.722058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb758-01ef-4a51-b253-838a358d4a87 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:56.722341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb758-01ef-4a51-b253-838a358d4a87 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:56.722618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb758-01ef-4a51-b253-838a358d4a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:56.742621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d6dcb758-01ef-4a51-b253-838a358d4a87 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:56.743871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d6dcb758-01ef-4a51-b253-838a358d4a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:56.819404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1137/2253] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:56.820410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39409ecabf674a8fb3b973b126f0e1a7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:56.824810 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39409ecabf674a8fb3b973b126f0e1a7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:56.828078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcb758-01ef-4a51-b253-838a358d4a87 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:56.830034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d6dcb758-01ef-4a51-b253-838a358d4a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:56.840884 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39409ecabf674a8fb3b973b126f0e1a7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:56.987061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39409ecabf674a8fb3b973b126f0e1a7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:56.988049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcb758-01ef-4a51-b253-838a358d4a87 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:56.988049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8bb4-ba51-40b7-bdef-4780dadf78d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:56.988049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8bb4-ba51-40b7-bdef-4780dadf78d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:56.988049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8bb4-ba51-40b7-bdef-4780dadf78d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:56.988617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8bb4-ba51-40b7-bdef-4780dadf78d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:56.988617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8bb4-ba51-40b7-bdef-4780dadf78d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:56.988617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8bb4-ba51-40b7-bdef-4780dadf78d5 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:56.988617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1138/2254] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:56.988617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8bb4-ba51-40b7-bdef-4780dadf78d5 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:56.988617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b0fa8bb4-ba51-40b7-bdef-4780dadf78d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:56.989543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8bb4-ba51-40b7-bdef-4780dadf78d5 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:56.989543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:56.989543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:56.989543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:56.990355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] PATH_INFO: `/v3/users/ff67ad579971489695b0100d1ce3ba56` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:56.990355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff67ad579971489695b0100d1ce3ba56)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:56.990355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:56.991286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:57.044787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-96df9479-1da6-4e5c-a34c-2b42f935ad7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39409ecabf674a8fb3b973b126f0e1a7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.051290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1117/2255] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:56 2022] DELETE /identity/v3/users/39409ecabf674a8fb3b973b126f0e1a7 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:57.056413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727982a-97d1-44b2-a032-bdcc267827f9 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:57.056413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727982a-97d1-44b2-a032-bdcc267827f9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:57.056653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727982a-97d1-44b2-a032-bdcc267827f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:57.075805 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f727982a-97d1-44b2-a032-bdcc267827f9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:57.076981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f727982a-97d1-44b2-a032-bdcc267827f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:57.139062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1118/2256] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:57.156493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727982a-97d1-44b2-a032-bdcc267827f9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:57.157859 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f727982a-97d1-44b2-a032-bdcc267827f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:57.222994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727982a-97d1-44b2-a032-bdcc267827f9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:57.223202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd0db7-b841-4dca-85b9-8487244ad888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:57.223834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd0db7-b841-4dca-85b9-8487244ad888 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:57.224163 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd0db7-b841-4dca-85b9-8487244ad888 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:57.224436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd0db7-b841-4dca-85b9-8487244ad888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:57.235239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd0db7-b841-4dca-85b9-8487244ad888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:57.236749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd0db7-b841-4dca-85b9-8487244ad888 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:57.248675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1119/2257] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:32:57.297659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:57.323143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff67ad579971489695b0100d1ce3ba56'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.383097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd0db7-b841-4dca-85b9-8487244ad888 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:57.390730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-72bd0db7-b841-4dca-85b9-8487244ad888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:57.400481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd0db7-b841-4dca-85b9-8487244ad888 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:57.405486 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:57.406110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:57.407835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:57.407835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] PATH_INFO: `/v3/users/196e33313a294e7f93cebd8f9b364eb3` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:57.422860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff67ad579971489695b0100d1ce3ba56'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.428474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196e33313a294e7f93cebd8f9b364eb3)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:57.433224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff67ad579971489695b0100d1ce3ba56'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.434516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff67ad579971489695b0100d1ce3ba56'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.435468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:57.466225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-485305b3-de05-4531-b1d4-38dbf83cd3b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff67ad579971489695b0100d1ce3ba56'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.481526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1139/2258] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:56 2022] DELETE /identity/v3/users/ff67ad579971489695b0100d1ce3ba56 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:57.490881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5596948-6f2c-4050-aebd-265ecd32f2fb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:57.491163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5596948-6f2c-4050-aebd-265ecd32f2fb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:57.491435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5596948-6f2c-4050-aebd-265ecd32f2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:57.511483 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b5596948-6f2c-4050-aebd-265ecd32f2fb None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:57.512770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b5596948-6f2c-4050-aebd-265ecd32f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:57.588692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1140/2259] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:32:57.592565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5596948-6f2c-4050-aebd-265ecd32f2fb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:57.595857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b5596948-6f2c-4050-aebd-265ecd32f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:57.609144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5596948-6f2c-4050-aebd-265ecd32f2fb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:57.619844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:57.620530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:57.620815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:57.621099 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] PATH_INFO: `/v3/projects/eabc2edece814d93bd61a9e6b51d8da7` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:57.622287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eabc2edece814d93bd61a9e6b51d8da7)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:57.624550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:57.714888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196e33313a294e7f93cebd8f9b364eb3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.715783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196e33313a294e7f93cebd8f9b364eb3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.728957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196e33313a294e7f93cebd8f9b364eb3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.736519 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196e33313a294e7f93cebd8f9b364eb3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.743735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eabc2edece814d93bd61a9e6b51d8da7', 'request_id': 'req-2f510b8d-4870-461c-ab36-32d49669ab1a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.749418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eabc2edece814d93bd61a9e6b51d8da7', 'request_id': 'req-2f510b8d-4870-461c-ab36-32d49669ab1a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.756824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eabc2edece814d93bd61a9e6b51d8da7', 'request_id': 'req-2f510b8d-4870-461c-ab36-32d49669ab1a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.820368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196e33313a294e7f93cebd8f9b364eb3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.830605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1120/2260] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:57 2022] DELETE /identity/v3/users/196e33313a294e7f93cebd8f9b364eb3 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:32:57.831488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:57.834515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:57.900753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] The token cache is being invalidate because project eabc2edece814d93bd61a9e6b51d8da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:57.901137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.901869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:57.903481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1141/2261] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:57 2022] DELETE /identity/v3/projects/eabc2edece814d93bd61a9e6b51d8da7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:57.904296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:57.905652 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:57.916217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81362d91-90db-4e83-be19-8177b39e6e66 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:57.919844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768bd9b-065b-417e-8192-6722ad782c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:57.920948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768bd9b-065b-417e-8192-6722ad782c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:57.920948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768bd9b-065b-417e-8192-6722ad782c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:57.921241 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768bd9b-065b-417e-8192-6722ad782c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:57.922763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d768bd9b-065b-417e-8192-6722ad782c5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:57.972924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f510b8d-4870-461c-ab36-32d49669ab1a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:57.989952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768bd9b-065b-417e-8192-6722ad782c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:57.991505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768bd9b-065b-417e-8192-6722ad782c5c service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:58.001918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1121/2262] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:58.005378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844a5d-ec79-48e6-99ea-7c68e8ed70d2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:58.005817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844a5d-ec79-48e6-99ea-7c68e8ed70d2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:58.005987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844a5d-ec79-48e6-99ea-7c68e8ed70d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:58.029878 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7a844a5d-ec79-48e6-99ea-7c68e8ed70d2 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:58.031403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7a844a5d-ec79-48e6-99ea-7c68e8ed70d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:58.041311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1122/2263] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:58.044483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a844a5d-ec79-48e6-99ea-7c68e8ed70d2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:58.044483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7a844a5d-ec79-48e6-99ea-7c68e8ed70d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:58.047978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:58.048869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:58.049184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:58.049437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] PATH_INFO: `/v3/projects/17f98da5d3354d36ae728b5bfbde6012` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:58.050628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f98da5d3354d36ae728b5bfbde6012)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:58.053229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:58.055849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a844a5d-ec79-48e6-99ea-7c68e8ed70d2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:58.062731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:58.067391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:58.068167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:58.068793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:58.068793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] PATH_INFO: `/v3/users/68e5c5c46d6545babbbb9409f0e126d4` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:58.069944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e5c5c46d6545babbbb9409f0e126d4)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:58.072306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:58.142874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:58.339763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e5c5c46d6545babbbb9409f0e126d4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.340303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f98da5d3354d36ae728b5bfbde6012', 'request_id': 'req-c2f90d5e-9cbf-4952-9c98-dded950efbe1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.340479 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e5c5c46d6545babbbb9409f0e126d4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.349204 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f98da5d3354d36ae728b5bfbde6012', 'request_id': 'req-c2f90d5e-9cbf-4952-9c98-dded950efbe1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.355563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f98da5d3354d36ae728b5bfbde6012', 'request_id': 'req-c2f90d5e-9cbf-4952-9c98-dded950efbe1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.357101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e5c5c46d6545babbbb9409f0e126d4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.368055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e5c5c46d6545babbbb9409f0e126d4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.450762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] The token cache is being invalidate because project 17f98da5d3354d36ae728b5bfbde6012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:58.451050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.451816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.456152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1142/2264] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:57 2022] DELETE /identity/v3/projects/17f98da5d3354d36ae728b5bfbde6012 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:58.456152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:58.459157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:58.536304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1d67f563-1278-420d-913d-9ec94ecddf6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e5c5c46d6545babbbb9409f0e126d4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.540463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f90d5e-9cbf-4952-9c98-dded950efbe1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:58.540853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d4c24-91d3-403f-8f9c-50bc89972467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:58.541214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d4c24-91d3-403f-8f9c-50bc89972467 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:58.541495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d4c24-91d3-403f-8f9c-50bc89972467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:58.541773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d4c24-91d3-403f-8f9c-50bc89972467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:58.544254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1123/2265] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:58 2022] DELETE /identity/v3/users/68e5c5c46d6545babbbb9409f0e126d4 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:58.544405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-001d4c24-91d3-403f-8f9c-50bc89972467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:58.549045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0ebc3-8e54-4f1d-9531-5eb40863d307 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:58.549444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0ebc3-8e54-4f1d-9531-5eb40863d307 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:58.549814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0ebc3-8e54-4f1d-9531-5eb40863d307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:58.576892 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5ce0ebc3-8e54-4f1d-9531-5eb40863d307 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:58.578193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5ce0ebc3-8e54-4f1d-9531-5eb40863d307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:58.641253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d4c24-91d3-403f-8f9c-50bc89972467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:58.642832 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d4c24-91d3-403f-8f9c-50bc89972467 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:58.653573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1143/2266] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:32:58.654432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d4c24-91d3-403f-8f9c-50bc89972467 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:58.655795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-001d4c24-91d3-403f-8f9c-50bc89972467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:58.657718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1124/2267] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:58.666220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fef787-a6d0-496e-9858-e3886ff6758f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:58.666505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fef787-a6d0-496e-9858-e3886ff6758f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:58.666795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fef787-a6d0-496e-9858-e3886ff6758f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:58.675013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d4c24-91d3-403f-8f9c-50bc89972467 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:58.682462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:58.682462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:58.682462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:58.682462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] PATH_INFO: `/v3/projects/d2855e7f4c124d0e90816dad4ff314fc` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:58.683292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2855e7f4c124d0e90816dad4ff314fc)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:58.685288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:58.694937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c3fef787-a6d0-496e-9858-e3886ff6758f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:58.697224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c3fef787-a6d0-496e-9858-e3886ff6758f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:58.712062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1125/2268] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:58.718411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fef787-a6d0-496e-9858-e3886ff6758f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:58.723390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fef787-a6d0-496e-9858-e3886ff6758f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:58.729431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93cdef-3c9c-49b5-9d37-87f19b83a44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:58.730049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93cdef-3c9c-49b5-9d37-87f19b83a44e admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:58.730322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93cdef-3c9c-49b5-9d37-87f19b83a44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:58.730589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93cdef-3c9c-49b5-9d37-87f19b83a44e admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:58.731232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93cdef-3c9c-49b5-9d37-87f19b83a44e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:32:58.731529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93cdef-3c9c-49b5-9d37-87f19b83a44e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:58.733687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93cdef-3c9c-49b5-9d37-87f19b83a44e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:58.751725 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1126/2269] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:32:58.752852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93cdef-3c9c-49b5-9d37-87f19b83a44e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:58.764224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93cdef-3c9c-49b5-9d37-87f19b83a44e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:58.769265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953a879-0aaf-460e-9a76-435674a11ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:58.769863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953a879-0aaf-460e-9a76-435674a11ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:58.773968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953a879-0aaf-460e-9a76-435674a11ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:58.773968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953a879-0aaf-460e-9a76-435674a11ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:58.773968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953a879-0aaf-460e-9a76-435674a11ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:58.773968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953a879-0aaf-460e-9a76-435674a11ffa admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:58.822333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:58.886565 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1127/2270] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:32:58 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:32:58.890727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953a879-0aaf-460e-9a76-435674a11ffa admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:58.899172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2855e7f4c124d0e90816dad4ff314fc', 'request_id': 'req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.905452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2855e7f4c124d0e90816dad4ff314fc', 'request_id': 'req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.912781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2855e7f4c124d0e90816dad4ff314fc', 'request_id': 'req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:58.918437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:58.966383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953a879-0aaf-460e-9a76-435674a11ffa admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:58.971305 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0daf27-b7d2-40a8-ba08-9a81ad816db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:58.971958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0daf27-b7d2-40a8-ba08-9a81ad816db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:58.972321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0daf27-b7d2-40a8-ba08-9a81ad816db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:58.972510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0daf27-b7d2-40a8-ba08-9a81ad816db5 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:58.973673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0daf27-b7d2-40a8-ba08-9a81ad816db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:58.976316 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0daf27-b7d2-40a8-ba08-9a81ad816db5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:59.003330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] The token cache is being invalidate because project d2855e7f4c124d0e90816dad4ff314fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:59.003623 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.004302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.006184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1144/2271] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:58 2022] DELETE /identity/v3/projects/d2855e7f4c124d0e90816dad4ff314fc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:59.006725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:59.008293 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:59.084462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1128/2272] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:32:58 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:32:59.085019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab7d58-e73c-4d2d-af93-616a4d6cb8bd admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:59.085301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0daf27-b7d2-40a8-ba08-9a81ad816db5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:59.089988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9b0daf27-b7d2-40a8-ba08-9a81ad816db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:59.092388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:59.093344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:59.093819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:59.094295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] PATH_INFO: `/v3/users/ad3ff41148f347f2993d31a04739accc` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:59.099238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3ff41148f347f2993d31a04739accc)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:59.101791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:59.107975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0daf27-b7d2-40a8-ba08-9a81ad816db5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:59.113151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:59.113939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:59.114275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:59.114768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] PATH_INFO: `/v3/users/81650d705d1f4c9ca6c4d23f2c15a43e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:59.116102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81650d705d1f4c9ca6c4d23f2c15a43e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:59.118703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:59.333551 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3ff41148f347f2993d31a04739accc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.362640 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81650d705d1f4c9ca6c4d23f2c15a43e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.363323 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81650d705d1f4c9ca6c4d23f2c15a43e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.376758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81650d705d1f4c9ca6c4d23f2c15a43e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.384075 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81650d705d1f4c9ca6c4d23f2c15a43e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.393624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3ff41148f347f2993d31a04739accc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.400849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3ff41148f347f2993d31a04739accc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.401608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3ff41148f347f2993d31a04739accc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.414893 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3ff41148f347f2993d31a04739accc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.421104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1145/2273] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:59 2022] DELETE /identity/v3/users/ad3ff41148f347f2993d31a04739accc => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:59.421877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:59.425064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:59.473812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81650d705d1f4c9ca6c4d23f2c15a43e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.483600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1129/2274] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:59 2022] DELETE /identity/v3/users/81650d705d1f4c9ca6c4d23f2c15a43e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:59.483600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:59.483600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:59.502141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb276-61d8-402c-ab91-14260faf681a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:59.568681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db6b0c-88b1-49c9-9c6a-66f0890c58da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:59.569305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db6b0c-88b1-49c9-9c6a-66f0890c58da admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:59.569586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db6b0c-88b1-49c9-9c6a-66f0890c58da admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:59.569857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db6b0c-88b1-49c9-9c6a-66f0890c58da admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:59.570505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db6b0c-88b1-49c9-9c6a-66f0890c58da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:59.572153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db6b0c-88b1-49c9-9c6a-66f0890c58da admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:59.584477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88739c-3e0f-4f50-a085-ef894fb23073 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:59.592606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:59.594024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:59.594024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:59.594024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] PATH_INFO: `/v3/projects/018c18ba0ecc4a0eb91258b9a8137442` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:59.594331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1146/2275] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:59.595496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db6b0c-88b1-49c9-9c6a-66f0890c58da admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:59.598092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=018c18ba0ecc4a0eb91258b9a8137442)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:59.603037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:59.604613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-54db6b0c-88b1-49c9-9c6a-66f0890c58da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:59.619130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db6b0c-88b1-49c9-9c6a-66f0890c58da admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:59.627014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:59.627854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:59.633582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:59.633582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] PATH_INFO: `/v3/projects/ee05ea8a6bb4424bade5f9e9fa09ad54` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:59.633582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee05ea8a6bb4424bade5f9e9fa09ad54)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:59.633582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:59.734663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018c18ba0ecc4a0eb91258b9a8137442', 'request_id': 'req-161d2fa3-c492-418f-9424-6ea3dd29ebe6'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.741293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018c18ba0ecc4a0eb91258b9a8137442', 'request_id': 'req-161d2fa3-c492-418f-9424-6ea3dd29ebe6'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.748156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018c18ba0ecc4a0eb91258b9a8137442', 'request_id': 'req-161d2fa3-c492-418f-9424-6ea3dd29ebe6'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.790681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee05ea8a6bb4424bade5f9e9fa09ad54', 'request_id': 'req-66c4ca75-78fa-4a73-a865-dc061f0ebaba'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.797259 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee05ea8a6bb4424bade5f9e9fa09ad54', 'request_id': 'req-66c4ca75-78fa-4a73-a865-dc061f0ebaba'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.804425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee05ea8a6bb4424bade5f9e9fa09ad54', 'request_id': 'req-66c4ca75-78fa-4a73-a865-dc061f0ebaba'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.857689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] The token cache is being invalidate because project 018c18ba0ecc4a0eb91258b9a8137442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:59.858100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.858816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-161d2fa3-c492-418f-9424-6ea3dd29ebe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.860507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1130/2276] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:59 2022] DELETE /identity/v3/projects/018c18ba0ecc4a0eb91258b9a8137442 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:59.861946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a35a45-e78d-44e9-a3b0-21691dd822b7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:59.862293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a35a45-e78d-44e9-a3b0-21691dd822b7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:59.862626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a35a45-e78d-44e9-a3b0-21691dd822b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:59.883654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-71a35a45-e78d-44e9-a3b0-21691dd822b7 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:59.889201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-71a35a45-e78d-44e9-a3b0-21691dd822b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:59.941218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] The token cache is being invalidate because project ee05ea8a6bb4424bade5f9e9fa09ad54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:32:59.941508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.942144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66c4ca75-78fa-4a73-a865-dc061f0ebaba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:32:59.942854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1131/2277] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:59.943698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a35a45-e78d-44e9-a3b0-21691dd822b7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:59.943846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1147/2278] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:32:59 2022] DELETE /identity/v3/projects/ee05ea8a6bb4424bade5f9e9fa09ad54 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:32:59.945064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c380e-8d79-482e-a503-c2124e7940a4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:59.945475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-71a35a45-e78d-44e9-a3b0-21691dd822b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:59.945578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c380e-8d79-482e-a503-c2124e7940a4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:59.945827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c380e-8d79-482e-a503-c2124e7940a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:59.958291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a35a45-e78d-44e9-a3b0-21691dd822b7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:32:59.964567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240526d5-4514-47ef-88e5-fbe1339fbae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:32:59.964567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240526d5-4514-47ef-88e5-fbe1339fbae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:32:59.964567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240526d5-4514-47ef-88e5-fbe1339fbae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:32:59.965122 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240526d5-4514-47ef-88e5-fbe1339fbae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:32:59.966251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240526d5-4514-47ef-88e5-fbe1339fbae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:32:59.966840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-075c380e-8d79-482e-a503-c2124e7940a4 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:32:59.968138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-075c380e-8d79-482e-a503-c2124e7940a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:59.968298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240526d5-4514-47ef-88e5-fbe1339fbae3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:32:59.978738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1148/2279] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:32:59.979776 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c380e-8d79-482e-a503-c2124e7940a4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:59.981135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-075c380e-8d79-482e-a503-c2124e7940a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:59.988302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1132/2280] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:32:59.989753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240526d5-4514-47ef-88e5-fbe1339fbae3 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:32:59.992216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-240526d5-4514-47ef-88e5-fbe1339fbae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:32:59.995854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c380e-8d79-482e-a503-c2124e7940a4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:00.001807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:00.002356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:00.002634 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:00.002957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] PATH_INFO: `/v3/users/3558a11f6a994183b087126e1fd48678` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:00.004133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3558a11f6a994183b087126e1fd48678)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:00.006055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:00.049971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:00.054806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240526d5-4514-47ef-88e5-fbe1339fbae3 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:00.058630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2af96b-12a5-45ab-98d0-06f1d26c52fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:00.059230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2af96b-12a5-45ab-98d0-06f1d26c52fb service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:00.059511 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2af96b-12a5-45ab-98d0-06f1d26c52fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:00.059785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2af96b-12a5-45ab-98d0-06f1d26c52fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:00.061553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9e2af96b-12a5-45ab-98d0-06f1d26c52fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:00.073521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2af96b-12a5-45ab-98d0-06f1d26c52fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:00.075157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2af96b-12a5-45ab-98d0-06f1d26c52fb service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:00.085409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1133/2281] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:00.086308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2af96b-12a5-45ab-98d0-06f1d26c52fb service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:00.087627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9e2af96b-12a5-45ab-98d0-06f1d26c52fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:00.099106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2af96b-12a5-45ab-98d0-06f1d26c52fb service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:00.104498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:00.105119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:00.105400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:00.105675 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] PATH_INFO: `/v3/projects/575591832d5e4b049a99b51822845e98` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:00.106797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575591832d5e4b049a99b51822845e98)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:00.108747 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:00.164484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3558a11f6a994183b087126e1fd48678'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.238021 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575591832d5e4b049a99b51822845e98', 'request_id': 'req-6f6198bb-e82e-4e22-90c0-314fe15377f2'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.244027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3558a11f6a994183b087126e1fd48678'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.247281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575591832d5e4b049a99b51822845e98', 'request_id': 'req-6f6198bb-e82e-4e22-90c0-314fe15377f2'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.247616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:00.254661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3558a11f6a994183b087126e1fd48678'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.255450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3558a11f6a994183b087126e1fd48678'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.260122 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575591832d5e4b049a99b51822845e98', 'request_id': 'req-6f6198bb-e82e-4e22-90c0-314fe15377f2'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.270258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e5bca09-3370-4f7a-9e51-68ed95b7eedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3558a11f6a994183b087126e1fd48678'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.279656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1149/2282] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:32:59 2022] DELETE /identity/v3/users/3558a11f6a994183b087126e1fd48678 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:00.281128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78f9d-374a-491a-9382-c9011a6b4679 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:00.282954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78f9d-374a-491a-9382-c9011a6b4679 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:00.282954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78f9d-374a-491a-9382-c9011a6b4679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:00.312142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8ff78f9d-374a-491a-9382-c9011a6b4679 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:00.312293 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8ff78f9d-374a-491a-9382-c9011a6b4679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:00.374518 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1150/2283] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:00.375770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff78f9d-374a-491a-9382-c9011a6b4679 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:00.378978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8ff78f9d-374a-491a-9382-c9011a6b4679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:00.394777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] The token cache is being invalidate because project 575591832d5e4b049a99b51822845e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:00.395053 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff78f9d-374a-491a-9382-c9011a6b4679 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:00.395169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.395726 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.398508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1134/2284] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:00 2022] DELETE /identity/v3/projects/575591832d5e4b049a99b51822845e98 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:00.399238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:00.400698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:00.402544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839b84-4b15-4984-9a2b-b50b2f4cf653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:00.403475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839b84-4b15-4984-9a2b-b50b2f4cf653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:00.404457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839b84-4b15-4984-9a2b-b50b2f4cf653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:00.404954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839b84-4b15-4984-9a2b-b50b2f4cf653 admin admin] PATH_INFO: `/v3/projects/da2df764bd0a40b091f46a172de340dd/users/0a4264979239468c86325ed2999e457b/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:00.422789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7839b84-4b15-4984-9a2b-b50b2f4cf653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2df764bd0a40b091f46a172de340dd, user_id=0a4264979239468c86325ed2999e457b, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:00.425855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7839b84-4b15-4984-9a2b-b50b2f4cf653 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:00.470491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6198bb-e82e-4e22-90c0-314fe15377f2 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:00.475321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007066d-07f6-4118-8501-8157d19a019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:00.476035 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007066d-07f6-4118-8501-8157d19a019f admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:00.476386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007066d-07f6-4118-8501-8157d19a019f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:00.476745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007066d-07f6-4118-8501-8157d19a019f admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:00.477451 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007066d-07f6-4118-8501-8157d19a019f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:00.477857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007066d-07f6-4118-8501-8157d19a019f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:00.479583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007066d-07f6-4118-8501-8157d19a019f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:00.498706 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1135/2285] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:33:00.498706 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007066d-07f6-4118-8501-8157d19a019f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:00.500473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8007066d-07f6-4118-8501-8157d19a019f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:00.515246 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007066d-07f6-4118-8501-8157d19a019f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:00.521646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:00.523665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:00.523665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:00.523665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] PATH_INFO: `/v3/users/a1d4c5a0ec9a48f5b2bc61c17ad5d879` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:00.525613 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d4c5a0ec9a48f5b2bc61c17ad5d879)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:00.527558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:00.528886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1151/2286] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:00 2022] PUT /identity/v3/projects/da2df764bd0a40b091f46a172de340dd/users/0a4264979239468c86325ed2999e457b/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:00.529816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839b84-4b15-4984-9a2b-b50b2f4cf653 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:00.602876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839b84-4b15-4984-9a2b-b50b2f4cf653 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:00.608368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5575a0-30fe-4bb2-88be-7b9971a5bb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:00.609097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5575a0-30fe-4bb2-88be-7b9971a5bb4f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:00.609489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5575a0-30fe-4bb2-88be-7b9971a5bb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:00.609813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5575a0-30fe-4bb2-88be-7b9971a5bb4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:00.610614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5575a0-30fe-4bb2-88be-7b9971a5bb4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:00.613960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5575a0-30fe-4bb2-88be-7b9971a5bb4f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:00.736833 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1152/2287] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:00 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:00.736833 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f5f08-51ab-4518-8210-26a9c1b26c16 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:00.736833 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f5f08-51ab-4518-8210-26a9c1b26c16 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:00.736833 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f5f08-51ab-4518-8210-26a9c1b26c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:00.769457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d4c5a0ec9a48f5b2bc61c17ad5d879'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.770334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d4c5a0ec9a48f5b2bc61c17ad5d879'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.773256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f84f5f08-51ab-4518-8210-26a9c1b26c16 None None] MFA Rules not processed for user `0a4264979239468c86325ed2999e457b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:00.774506 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f84f5f08-51ab-4518-8210-26a9c1b26c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:00.785441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d4c5a0ec9a48f5b2bc61c17ad5d879'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.792579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d4c5a0ec9a48f5b2bc61c17ad5d879'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.844837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1153/2288] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:00.845880 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f5f08-51ab-4518-8210-26a9c1b26c16 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:00.847114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f84f5f08-51ab-4518-8210-26a9c1b26c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:00.868558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d4c5a0ec9a48f5b2bc61c17ad5d879'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:00.879239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1136/2289] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:00 2022] DELETE /identity/v3/users/a1d4c5a0ec9a48f5b2bc61c17ad5d879 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:00.880953 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:00.883854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:00.925906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f5f08-51ab-4518-8210-26a9c1b26c16 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:00.965047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53333f19-ff51-4b78-b8d4-d98264c5e4d4 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:00.967940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:00.974064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96282a1-f0f0-4fb4-a379-c94d649621d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:00.974867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96282a1-f0f0-4fb4-a379-c94d649621d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:00.975259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96282a1-f0f0-4fb4-a379-c94d649621d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:00.975540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96282a1-f0f0-4fb4-a379-c94d649621d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:00.976345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96282a1-f0f0-4fb4-a379-c94d649621d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:00.978625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96282a1-f0f0-4fb4-a379-c94d649621d0 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:01.015591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:01.016294 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:01.016572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:01.016842 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] PATH_INFO: `/v3/projects/c9ba0e8081a2479d9c6dec428e57d2b4` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:01.018035 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ba0e8081a2479d9c6dec428e57d2b4)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:01.020725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:01.055489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1137/2290] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:00 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:01.056670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96282a1-f0f0-4fb4-a379-c94d649621d0 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:01.058903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c96282a1-f0f0-4fb4-a379-c94d649621d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:01.097593 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:01.128486 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96282a1-f0f0-4fb4-a379-c94d649621d0 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:01.142084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44c40a-d005-4b00-bd51-e007959bb30d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:01.142926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c40a-d005-4b00-bd51-e007959bb30d service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:01.143149 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c40a-d005-4b00-bd51-e007959bb30d service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:01.143438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c40a-d005-4b00-bd51-e007959bb30d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:01.145958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5d44c40a-d005-4b00-bd51-e007959bb30d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:01.147050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ba0e8081a2479d9c6dec428e57d2b4', 'request_id': 'req-9e7d682e-f803-49d2-9390-03548e65a9c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.155257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ba0e8081a2479d9c6dec428e57d2b4', 'request_id': 'req-9e7d682e-f803-49d2-9390-03548e65a9c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.164133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ba0e8081a2479d9c6dec428e57d2b4', 'request_id': 'req-9e7d682e-f803-49d2-9390-03548e65a9c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.239107 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] The token cache is being invalidate because project c9ba0e8081a2479d9c6dec428e57d2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:01.242628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.242628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.243082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44c40a-d005-4b00-bd51-e007959bb30d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:01.244549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1154/2291] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:00 2022] DELETE /identity/v3/projects/c9ba0e8081a2479d9c6dec428e57d2b4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:01.245500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:01.251262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44c40a-d005-4b00-bd51-e007959bb30d service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:01.252657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:01.265522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1138/2292] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:01.269985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44c40a-d005-4b00-bd51-e007959bb30d service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:01.280690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44c40a-d005-4b00-bd51-e007959bb30d service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:01.338172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d682e-f803-49d2-9390-03548e65a9c0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:01.351391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:01.352391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:01.353098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:01.353635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] PATH_INFO: `/v3/projects/ce2878887645409f92e7970d2248d573` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:01.355472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2878887645409f92e7970d2248d573)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:01.357550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:01.374025 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59621a33-eb38-4d2f-a0c5-03dd695e6b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:01.374865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59621a33-eb38-4d2f-a0c5-03dd695e6b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:01.375140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59621a33-eb38-4d2f-a0c5-03dd695e6b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:01.375712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59621a33-eb38-4d2f-a0c5-03dd695e6b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:01.376819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59621a33-eb38-4d2f-a0c5-03dd695e6b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:01.379920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59621a33-eb38-4d2f-a0c5-03dd695e6b6c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:01.397588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1139/2293] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:01.398577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59621a33-eb38-4d2f-a0c5-03dd695e6b6c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:01.401342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-59621a33-eb38-4d2f-a0c5-03dd695e6b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:01.413358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:01.422529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59621a33-eb38-4d2f-a0c5-03dd695e6b6c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:01.428814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:01.429449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:01.429729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:01.430002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] PATH_INFO: `/v3/users/f57b60a6811a46d1ab3dc804279ff921` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:01.431157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57b60a6811a46d1ab3dc804279ff921)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:01.433323 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:01.548954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2878887645409f92e7970d2248d573', 'request_id': 'req-e3f7292e-d4db-467c-84b8-c9d66f71600d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.554904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2878887645409f92e7970d2248d573', 'request_id': 'req-e3f7292e-d4db-467c-84b8-c9d66f71600d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.561536 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2878887645409f92e7970d2248d573', 'request_id': 'req-e3f7292e-d4db-467c-84b8-c9d66f71600d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.673587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] The token cache is being invalidate because project ce2878887645409f92e7970d2248d573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:01.673842 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.674498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.676092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1155/2294] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:01 2022] DELETE /identity/v3/projects/ce2878887645409f92e7970d2248d573 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:01.676916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:01.678211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:01.702065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:01.721685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57b60a6811a46d1ab3dc804279ff921'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.722489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57b60a6811a46d1ab3dc804279ff921'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.737332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57b60a6811a46d1ab3dc804279ff921'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.744603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57b60a6811a46d1ab3dc804279ff921'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.771353 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7292e-d4db-467c-84b8-c9d66f71600d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:01.782305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432ed8-ff03-4716-bcbb-a69ebeec9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:01.782929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432ed8-ff03-4716-bcbb-a69ebeec9101 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:01.783205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432ed8-ff03-4716-bcbb-a69ebeec9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:01.783473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432ed8-ff03-4716-bcbb-a69ebeec9101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:01.784198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9432ed8-ff03-4716-bcbb-a69ebeec9101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:01.785774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9432ed8-ff03-4716-bcbb-a69ebeec9101 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:01.796918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1156/2295] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:01.797565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432ed8-ff03-4716-bcbb-a69ebeec9101 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:01.799210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e9432ed8-ff03-4716-bcbb-a69ebeec9101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:01.811391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432ed8-ff03-4716-bcbb-a69ebeec9101 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:01.814582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57b60a6811a46d1ab3dc804279ff921'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.816541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:01.817159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:01.817433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:01.817780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] PATH_INFO: `/v3/projects/7107449d30924c1cb7b99f54b1592c88` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:01.819113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7107449d30924c1cb7b99f54b1592c88)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:01.828181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:01.828510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1140/2296] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:01 2022] DELETE /identity/v3/users/f57b60a6811a46d1ab3dc804279ff921 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:01.828510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:01.828510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:01.912910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fe3e3-422c-46ff-aa62-67c0014cf4a4 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:01.917499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:01.918130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:01.918406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:01.918677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] PATH_INFO: `/v3/users/dc9f1503e627428f8de0d81dc5e70f15` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:01.921623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9f1503e627428f8de0d81dc5e70f15)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:01.921791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:01.959357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7107449d30924c1cb7b99f54b1592c88', 'request_id': 'req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.964969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7107449d30924c1cb7b99f54b1592c88', 'request_id': 'req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:01.971903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7107449d30924c1cb7b99f54b1592c88', 'request_id': 'req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.060939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] The token cache is being invalidate because project 7107449d30924c1cb7b99f54b1592c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:02.061444 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.062138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.067597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1157/2297] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:01 2022] DELETE /identity/v3/projects/7107449d30924c1cb7b99f54b1592c88 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:02.067597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:02.067597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:02.160489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5023d1c-4b8b-4bc8-ac82-3fa91e2729a8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:02.170078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9f1503e627428f8de0d81dc5e70f15'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.170930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9f1503e627428f8de0d81dc5e70f15'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.177009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bb763-4eea-4865-a6f2-4af55165772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:02.180715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bb763-4eea-4865-a6f2-4af55165772d admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.180715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bb763-4eea-4865-a6f2-4af55165772d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.180715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bb763-4eea-4865-a6f2-4af55165772d admin admin] PATH_INFO: `/v3/projects/75bb97ffbcce4af1b513cb0299ce9494/users/33e8cb7821f24df98972c8e7a9468a60/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.188060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9f1503e627428f8de0d81dc5e70f15'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.197948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9f1503e627428f8de0d81dc5e70f15'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.222952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bb763-4eea-4865-a6f2-4af55165772d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bb97ffbcce4af1b513cb0299ce9494, user_id=33e8cb7821f24df98972c8e7a9468a60, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:02.232402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bb763-4eea-4865-a6f2-4af55165772d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:02.300993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-13a343ec-21b8-4045-bb69-cc6119681513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9f1503e627428f8de0d81dc5e70f15'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.308249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1141/2298] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:01 2022] DELETE /identity/v3/users/dc9f1503e627428f8de0d81dc5e70f15 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:02.309556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cceac-f5ed-46b2-b3b4-b49c371b9d93 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.309793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cceac-f5ed-46b2-b3b4-b49c371b9d93 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.310061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cceac-f5ed-46b2-b3b4-b49c371b9d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.338138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-be5cceac-f5ed-46b2-b3b4-b49c371b9d93 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:02.338971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1158/2299] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:02 2022] PUT /identity/v3/projects/75bb97ffbcce4af1b513cb0299ce9494/users/33e8cb7821f24df98972c8e7a9468a60/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:02.339345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-be5cceac-f5ed-46b2-b3b4-b49c371b9d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:02.350170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0fa6f-b870-4baa-89b0-a72ffb62b3a6 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.350667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0fa6f-b870-4baa-89b0-a72ffb62b3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.351059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0fa6f-b870-4baa-89b0-a72ffb62b3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.397792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5ae0fa6f-b870-4baa-89b0-a72ffb62b3a6 None None] MFA Rules not processed for user `33e8cb7821f24df98972c8e7a9468a60`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:02.400420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5ae0fa6f-b870-4baa-89b0-a72ffb62b3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:02.403789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:02.420961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1142/2300] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:02.430084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276cb3-efda-4b37-b747-3f76352e6cc5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.430512 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276cb3-efda-4b37-b747-3f76352e6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.430851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276cb3-efda-4b37-b747-3f76352e6cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.455341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-12276cb3-efda-4b37-b747-3f76352e6cc5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:02.456686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-12276cb3-efda-4b37-b747-3f76352e6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:02.469695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1143/2301] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:02.470666 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12276cb3-efda-4b37-b747-3f76352e6cc5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:02.479909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12276cb3-efda-4b37-b747-3f76352e6cc5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:02.485293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6c818-af8c-4eb7-bc2c-bdf0a0e6d569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:02.485964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6c818-af8c-4eb7-bc2c-bdf0a0e6d569 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.486297 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6c818-af8c-4eb7-bc2c-bdf0a0e6d569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.486628 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6c818-af8c-4eb7-bc2c-bdf0a0e6d569 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.487333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6c818-af8c-4eb7-bc2c-bdf0a0e6d569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:02.487744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6c818-af8c-4eb7-bc2c-bdf0a0e6d569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:02.489505 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6c818-af8c-4eb7-bc2c-bdf0a0e6d569 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:02.502875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1159/2302] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:02.507714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1144/2303] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:33:02.511181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0fa6f-b870-4baa-89b0-a72ffb62b3a6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:02.512616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6c818-af8c-4eb7-bc2c-bdf0a0e6d569 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:02.514606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b1c6c818-af8c-4eb7-bc2c-bdf0a0e6d569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:02.522255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0fa6f-b870-4baa-89b0-a72ffb62b3a6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:02.527550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79a0b1-7915-4248-983d-c3e4ac3ce30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:02.528185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79a0b1-7915-4248-983d-c3e4ac3ce30c admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.532241 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6c818-af8c-4eb7-bc2c-bdf0a0e6d569 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:02.532495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79a0b1-7915-4248-983d-c3e4ac3ce30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.532495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79a0b1-7915-4248-983d-c3e4ac3ce30c admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.532495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79a0b1-7915-4248-983d-c3e4ac3ce30c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:02.532495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79a0b1-7915-4248-983d-c3e4ac3ce30c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:02.533752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed42784-5bae-40f6-8cae-da9d42b6c1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:02.534368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed42784-5bae-40f6-8cae-da9d42b6c1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.534739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed42784-5bae-40f6-8cae-da9d42b6c1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.535267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed42784-5bae-40f6-8cae-da9d42b6c1d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.535965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed42784-5bae-40f6-8cae-da9d42b6c1d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:02.538125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed42784-5bae-40f6-8cae-da9d42b6c1d3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:02.641074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:02.653680 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1160/2304] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:02 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:02.654286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1145/2305] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:02 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:02.654788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79a0b1-7915-4248-983d-c3e4ac3ce30c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:02.654788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ec79a0b1-7915-4248-983d-c3e4ac3ce30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:02.655168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed42784-5bae-40f6-8cae-da9d42b6c1d3 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:02.722002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed42784-5bae-40f6-8cae-da9d42b6c1d3 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:02.722989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79a0b1-7915-4248-983d-c3e4ac3ce30c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:02.727181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc84090-0274-499b-aa19-6aec786c9502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:02.727782 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc84090-0274-499b-aa19-6aec786c9502 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.728082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc84090-0274-499b-aa19-6aec786c9502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.728319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:02.728425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc84090-0274-499b-aa19-6aec786c9502 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.728962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc84090-0274-499b-aa19-6aec786c9502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:02.729162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.729253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.729545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] PATH_INFO: `/v3/projects/c93e410292a841daa0156c6b819e4e9b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.730711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93e410292a841daa0156c6b819e4e9b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:02.730865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc84090-0274-499b-aa19-6aec786c9502 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:02.732691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:02.850490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1146/2306] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:02 2022] POST /identity/v3/users => generated 282 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:33:02.852372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc84090-0274-499b-aa19-6aec786c9502 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:02.861876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc84090-0274-499b-aa19-6aec786c9502 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:02.863786 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93e410292a841daa0156c6b819e4e9b', 'request_id': 'req-e23c2244-13e5-4a9a-965e-0e18f57de09e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.870061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93e410292a841daa0156c6b819e4e9b', 'request_id': 'req-e23c2244-13e5-4a9a-965e-0e18f57de09e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.876344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93e410292a841daa0156c6b819e4e9b', 'request_id': 'req-e23c2244-13e5-4a9a-965e-0e18f57de09e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.920497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecc23f-080b-4bdc-bf2f-0dc413fc3f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:02.921115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc23f-080b-4bdc-bf2f-0dc413fc3f51 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.921392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc23f-080b-4bdc-bf2f-0dc413fc3f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.921663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc23f-080b-4bdc-bf2f-0dc413fc3f51 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.922299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecc23f-080b-4bdc-bf2f-0dc413fc3f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:02.924268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecc23f-080b-4bdc-bf2f-0dc413fc3f51 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:02.951269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] The token cache is being invalidate because project c93e410292a841daa0156c6b819e4e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:02.951560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.952235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:02.953788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1161/2307] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:02 2022] DELETE /identity/v3/projects/c93e410292a841daa0156c6b819e4e9b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:02.954609 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:02.955995 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:02.969182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c2244-13e5-4a9a-965e-0e18f57de09e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:02.974411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:02.984462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:02.984462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:02.984462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] PATH_INFO: `/v3/projects/5b2d61ddc1f14656b7ceb3aeedaf2875` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:02.984462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2d61ddc1f14656b7ceb3aeedaf2875)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:02.984462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.016780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1147/2308] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:02 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:03.017760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecc23f-080b-4bdc-bf2f-0dc413fc3f51 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.019325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f0ecc23f-080b-4bdc-bf2f-0dc413fc3f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.031308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecc23f-080b-4bdc-bf2f-0dc413fc3f51 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.035902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d96e82-45e3-4a30-b6cf-8f5b2353b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.037051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96e82-45e3-4a30-b6cf-8f5b2353b7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.037331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96e82-45e3-4a30-b6cf-8f5b2353b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.037603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96e82-45e3-4a30-b6cf-8f5b2353b7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.039788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d96e82-45e3-4a30-b6cf-8f5b2353b7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.041403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d96e82-45e3-4a30-b6cf-8f5b2353b7f2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.051874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1148/2309] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:03.053283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fda179-3b80-4e22-8d44-3f43580701f8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.053648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fda179-3b80-4e22-8d44-3f43580701f8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.053924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fda179-3b80-4e22-8d44-3f43580701f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.080013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-97fda179-3b80-4e22-8d44-3f43580701f8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:03.080013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-97fda179-3b80-4e22-8d44-3f43580701f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.083931 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1149/2310] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:03.085209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fda179-3b80-4e22-8d44-3f43580701f8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.087208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-97fda179-3b80-4e22-8d44-3f43580701f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.098657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fda179-3b80-4e22-8d44-3f43580701f8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.112302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2d61ddc1f14656b7ceb3aeedaf2875', 'request_id': 'req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:03.118854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2d61ddc1f14656b7ceb3aeedaf2875', 'request_id': 'req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:03.126230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2d61ddc1f14656b7ceb3aeedaf2875', 'request_id': 'req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:03.157858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a63bd-f18c-46ae-886c-661466fdada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.158467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a63bd-f18c-46ae-886c-661466fdada7 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.161282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a63bd-f18c-46ae-886c-661466fdada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.161282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a63bd-f18c-46ae-886c-661466fdada7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.161282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a63bd-f18c-46ae-886c-661466fdada7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.161570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a63bd-f18c-46ae-886c-661466fdada7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.171408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1150/2311] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:03.172278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a63bd-f18c-46ae-886c-661466fdada7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.182895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a63bd-f18c-46ae-886c-661466fdada7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.185280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:03.190061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521adb92-a541-4cb6-8e55-93b12d0efc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.190867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521adb92-a541-4cb6-8e55-93b12d0efc2a admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.191121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521adb92-a541-4cb6-8e55-93b12d0efc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.191392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521adb92-a541-4cb6-8e55-93b12d0efc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.192328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521adb92-a541-4cb6-8e55-93b12d0efc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.193730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521adb92-a541-4cb6-8e55-93b12d0efc2a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.204385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1151/2312] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:03.205575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9cd91-381d-4314-98b0-496c2e329db5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.205856 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9cd91-381d-4314-98b0-496c2e329db5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.206124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9cd91-381d-4314-98b0-496c2e329db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.226718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] The token cache is being invalidate because project 5b2d61ddc1f14656b7ceb3aeedaf2875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:03.226718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:03.226718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:03.226718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1162/2313] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:02 2022] DELETE /identity/v3/projects/5b2d61ddc1f14656b7ceb3aeedaf2875 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:03.226718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.227088 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.229206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6fe9cd91-381d-4314-98b0-496c2e329db5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:03.231871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6fe9cd91-381d-4314-98b0-496c2e329db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.235569 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9231d5-fe49-47b5-a895-4fa161a9b1f7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.244556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1152/2314] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:03.244763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46155baf-cd5d-49dd-9ae0-e6cab3ee335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.244763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46155baf-cd5d-49dd-9ae0-e6cab3ee335d admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.244949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9cd91-381d-4314-98b0-496c2e329db5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.245024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46155baf-cd5d-49dd-9ae0-e6cab3ee335d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.245024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46155baf-cd5d-49dd-9ae0-e6cab3ee335d admin admin] PATH_INFO: `/v3/projects/c08be4e3ceb94f9ab2415f9dffc1feb2/users/52924a5c9f244e6ea42cc9d21d85e2ff/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.245151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6fe9cd91-381d-4314-98b0-496c2e329db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.259672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9cd91-381d-4314-98b0-496c2e329db5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.259791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46155baf-cd5d-49dd-9ae0-e6cab3ee335d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08be4e3ceb94f9ab2415f9dffc1feb2, user_id=52924a5c9f244e6ea42cc9d21d85e2ff, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.262569 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46155baf-cd5d-49dd-9ae0-e6cab3ee335d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.264367 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54ae6a-6f95-453c-aa02-4af6e745ac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.265052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54ae6a-6f95-453c-aa02-4af6e745ac60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.265296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54ae6a-6f95-453c-aa02-4af6e745ac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.266000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54ae6a-6f95-453c-aa02-4af6e745ac60 admin admin] PATH_INFO: `/v3/projects/05575b1ef59e419eaf60e11a31035a80/users/74522d0113ec4739940403c9c8a8a21f/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.282629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54ae6a-6f95-453c-aa02-4af6e745ac60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05575b1ef59e419eaf60e11a31035a80, user_id=74522d0113ec4739940403c9c8a8a21f, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.285350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54ae6a-6f95-453c-aa02-4af6e745ac60 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.360685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1163/2315] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:03 2022] PUT /identity/v3/projects/c08be4e3ceb94f9ab2415f9dffc1feb2/users/52924a5c9f244e6ea42cc9d21d85e2ff/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:03.362359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc066f55-c2bf-4148-9a02-1bcf7b0dae8c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.363009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc066f55-c2bf-4148-9a02-1bcf7b0dae8c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.363419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc066f55-c2bf-4148-9a02-1bcf7b0dae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.374310 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1153/2316] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:03 2022] PUT /identity/v3/projects/05575b1ef59e419eaf60e11a31035a80/users/74522d0113ec4739940403c9c8a8a21f/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:03.375697 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54ae6a-6f95-453c-aa02-4af6e745ac60 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.386486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-dc066f55-c2bf-4148-9a02-1bcf7b0dae8c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:03.387703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dc066f55-c2bf-4148-9a02-1bcf7b0dae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.450413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54ae6a-6f95-453c-aa02-4af6e745ac60 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.455219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f3a7f-d5ef-4157-a01f-24e22bd8e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.455839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f3a7f-d5ef-4157-a01f-24e22bd8e3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.456158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f3a7f-d5ef-4157-a01f-24e22bd8e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.456494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f3a7f-d5ef-4157-a01f-24e22bd8e3e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.457144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f3a7f-d5ef-4157-a01f-24e22bd8e3e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:03.457448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f3a7f-d5ef-4157-a01f-24e22bd8e3e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.463772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f3a7f-d5ef-4157-a01f-24e22bd8e3e1 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.464014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1164/2317] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:03.464014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc066f55-c2bf-4148-9a02-1bcf7b0dae8c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.470764 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:03.475796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc066f55-c2bf-4148-9a02-1bcf7b0dae8c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.479503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598ddf8-0d69-4cdd-8b13-df3bf207a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.480222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598ddf8-0d69-4cdd-8b13-df3bf207a16f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.480806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598ddf8-0d69-4cdd-8b13-df3bf207a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.481153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598ddf8-0d69-4cdd-8b13-df3bf207a16f admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.485434 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1154/2318] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:33:03.485578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598ddf8-0d69-4cdd-8b13-df3bf207a16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.485674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbdbeb-640a-4728-bde4-a01d07d17eef None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.485674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbdbeb-640a-4728-bde4-a01d07d17eef None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.485674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbdbeb-640a-4728-bde4-a01d07d17eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.485914 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598ddf8-0d69-4cdd-8b13-df3bf207a16f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.495021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1165/2319] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:03.496281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65ede2-d00a-46c5-8597-a7a2142a3a2e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.500613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65ede2-d00a-46c5-8597-a7a2142a3a2e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.500613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65ede2-d00a-46c5-8597-a7a2142a3a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.514465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5acbdbeb-640a-4728-bde4-a01d07d17eef None None] MFA Rules not processed for user `74522d0113ec4739940403c9c8a8a21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:03.515793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5acbdbeb-640a-4728-bde4-a01d07d17eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.528468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ac65ede2-d00a-46c5-8597-a7a2142a3a2e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:03.529823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ac65ede2-d00a-46c5-8597-a7a2142a3a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.542235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1166/2320] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:03.542235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65ede2-d00a-46c5-8597-a7a2142a3a2e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.549663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65ede2-d00a-46c5-8597-a7a2142a3a2e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.554805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214349e3-2ec1-4f08-9982-9e9c11edeed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.555413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214349e3-2ec1-4f08-9982-9e9c11edeed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.555695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214349e3-2ec1-4f08-9982-9e9c11edeed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.558654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214349e3-2ec1-4f08-9982-9e9c11edeed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.559207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214349e3-2ec1-4f08-9982-9e9c11edeed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.561198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214349e3-2ec1-4f08-9982-9e9c11edeed0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.570184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:03.597946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1155/2321] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:03.602174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbdbeb-640a-4728-bde4-a01d07d17eef None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.613577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbdbeb-640a-4728-bde4-a01d07d17eef None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.618604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759725b-f50d-4918-97ab-2f8fd61f7ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.619286 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759725b-f50d-4918-97ab-2f8fd61f7ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.619564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759725b-f50d-4918-97ab-2f8fd61f7ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.619918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759725b-f50d-4918-97ab-2f8fd61f7ecb admin admin] PATH_INFO: `/v3/projects/c08be4e3ceb94f9ab2415f9dffc1feb2/users/52924a5c9f244e6ea42cc9d21d85e2ff/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.621853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759725b-f50d-4918-97ab-2f8fd61f7ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08be4e3ceb94f9ab2415f9dffc1feb2, user_id=52924a5c9f244e6ea42cc9d21d85e2ff, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.624618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759725b-f50d-4918-97ab-2f8fd61f7ecb admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.629343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:03.644427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1156/2322] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:03 2022] PUT /identity/v3/projects/c08be4e3ceb94f9ab2415f9dffc1feb2/users/52924a5c9f244e6ea42cc9d21d85e2ff/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:03.645506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759725b-f50d-4918-97ab-2f8fd61f7ecb admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.664211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1167/2323] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:03 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:03.665203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214349e3-2ec1-4f08-9982-9e9c11edeed0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.666926 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-214349e3-2ec1-4f08-9982-9e9c11edeed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.730349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759725b-f50d-4918-97ab-2f8fd61f7ecb admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.735597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214349e3-2ec1-4f08-9982-9e9c11edeed0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.742005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a7859-78d8-4ba6-9f08-0a1d1722dacf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.744722 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7859-78d8-4ba6-9f08-0a1d1722dacf service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.745002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7859-78d8-4ba6-9f08-0a1d1722dacf service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.745275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7859-78d8-4ba6-9f08-0a1d1722dacf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.752047 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:03.799225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870d13-ec78-457c-8b20-2b30aa77a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.799860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870d13-ec78-457c-8b20-2b30aa77a806 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.800169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870d13-ec78-457c-8b20-2b30aa77a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.800450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870d13-ec78-457c-8b20-2b30aa77a806 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.801110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870d13-ec78-457c-8b20-2b30aa77a806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:03.801489 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870d13-ec78-457c-8b20-2b30aa77a806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.803539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870d13-ec78-457c-8b20-2b30aa77a806 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.807710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:03.812264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a7859-78d8-4ba6-9f08-0a1d1722dacf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.817733 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a7859-78d8-4ba6-9f08-0a1d1722dacf service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.821576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1157/2324] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:33:03.821576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9555c-2ef4-468f-bdbb-5146f1426a6a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.821576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9555c-2ef4-468f-bdbb-5146f1426a6a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.821576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9555c-2ef4-468f-bdbb-5146f1426a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.833291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1168/2325] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:03.835696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a7859-78d8-4ba6-9f08-0a1d1722dacf service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.851086 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a7859-78d8-4ba6-9f08-0a1d1722dacf service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.856196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d7ad0-b2fe-4897-bd0e-a745b8cab5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.856978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d7ad0-b2fe-4897-bd0e-a745b8cab5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.857268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d7ad0-b2fe-4897-bd0e-a745b8cab5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.857558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d7ad0-b2fe-4897-bd0e-a745b8cab5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.858193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d7ad0-b2fe-4897-bd0e-a745b8cab5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.860384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d7ad0-b2fe-4897-bd0e-a745b8cab5a4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.871965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f4b9555c-2ef4-468f-bdbb-5146f1426a6a None None] MFA Rules not processed for user `52924a5c9f244e6ea42cc9d21d85e2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:03.872898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f4b9555c-2ef4-468f-bdbb-5146f1426a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:03.945885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:03.954743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1169/2326] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:03 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:03.954743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d7ad0-b2fe-4897-bd0e-a745b8cab5a4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.956192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1158/2327] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:03.956944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9555c-2ef4-468f-bdbb-5146f1426a6a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:03.970772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9555c-2ef4-468f-bdbb-5146f1426a6a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.983355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693327af-356a-48fb-b891-92e692947b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.984085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693327af-356a-48fb-b891-92e692947b9c admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.984301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693327af-356a-48fb-b891-92e692947b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.984576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693327af-356a-48fb-b891-92e692947b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.985246 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693327af-356a-48fb-b891-92e692947b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.987185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d7ad0-b2fe-4897-bd0e-a745b8cab5a4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:03.987648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693327af-356a-48fb-b891-92e692947b9c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:03.993089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa64cc2-8e7b-40d3-aca7-d68e370bc52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:03.993916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa64cc2-8e7b-40d3-aca7-d68e370bc52d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:03.994347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa64cc2-8e7b-40d3-aca7-d68e370bc52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:03.994788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa64cc2-8e7b-40d3-aca7-d68e370bc52d admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:03.995578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa64cc2-8e7b-40d3-aca7-d68e370bc52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:03.998199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1159/2328] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:03.998632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa64cc2-8e7b-40d3-aca7-d68e370bc52d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.002000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693327af-356a-48fb-b891-92e692947b9c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.017969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693327af-356a-48fb-b891-92e692947b9c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.023915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c37166-e50a-4449-8e23-0dcc867e9310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.024562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c37166-e50a-4449-8e23-0dcc867e9310 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.024847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c37166-e50a-4449-8e23-0dcc867e9310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.025110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c37166-e50a-4449-8e23-0dcc867e9310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.025751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c37166-e50a-4449-8e23-0dcc867e9310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.027460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c37166-e50a-4449-8e23-0dcc867e9310 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.038718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1160/2329] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:04.043064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c37166-e50a-4449-8e23-0dcc867e9310 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.052611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c37166-e50a-4449-8e23-0dcc867e9310 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.057332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11997e-79ee-40fc-aca9-fcb36174d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.057958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11997e-79ee-40fc-aca9-fcb36174d6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.058239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11997e-79ee-40fc-aca9-fcb36174d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.058513 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11997e-79ee-40fc-aca9-fcb36174d6f5 admin admin] PATH_INFO: `/v3/projects/f280ed3e8b394e40bfb5a456af6ee993/users/0298dd40cfe64e34bfdd5ca83bd8da79/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.074315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11997e-79ee-40fc-aca9-fcb36174d6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f280ed3e8b394e40bfb5a456af6ee993, user_id=0298dd40cfe64e34bfdd5ca83bd8da79, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.077137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11997e-79ee-40fc-aca9-fcb36174d6f5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.129812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:04.140612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1170/2330] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:03 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:04.140612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa64cc2-8e7b-40d3-aca7-d68e370bc52d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.140612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-afa64cc2-8e7b-40d3-aca7-d68e370bc52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:04.186481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1161/2331] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:04 2022] PUT /identity/v3/projects/f280ed3e8b394e40bfb5a456af6ee993/users/0298dd40cfe64e34bfdd5ca83bd8da79/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:04.196652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11997e-79ee-40fc-aca9-fcb36174d6f5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.198875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa64cc2-8e7b-40d3-aca7-d68e370bc52d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.253967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e7d62-4761-40e9-a071-9842737deb69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.254588 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e7d62-4761-40e9-a071-9842737deb69 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.254997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e7d62-4761-40e9-a071-9842737deb69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.255305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e7d62-4761-40e9-a071-9842737deb69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.264208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11997e-79ee-40fc-aca9-fcb36174d6f5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.269039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1dae2-1a5d-43af-9605-91e92f46a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.269629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1dae2-1a5d-43af-9605-91e92f46a1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.269907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1dae2-1a5d-43af-9605-91e92f46a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.270254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1dae2-1a5d-43af-9605-91e92f46a1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.270934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1dae2-1a5d-43af-9605-91e92f46a1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.273618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1dae2-1a5d-43af-9605-91e92f46a1c9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.321175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e7d62-4761-40e9-a071-9842737deb69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.322425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e7d62-4761-40e9-a071-9842737deb69 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.334946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1171/2332] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:04.336421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140935fa-703a-4719-ad11-1545eee24976 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.336712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140935fa-703a-4719-ad11-1545eee24976 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.337070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140935fa-703a-4719-ad11-1545eee24976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.358158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1162/2333] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:04 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:04.360881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1dae2-1a5d-43af-9605-91e92f46a1c9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.365731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-140935fa-703a-4719-ad11-1545eee24976 None None] MFA Rules not processed for user `0298dd40cfe64e34bfdd5ca83bd8da79`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:04.367031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-140935fa-703a-4719-ad11-1545eee24976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:04.369323 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1dae2-1a5d-43af-9605-91e92f46a1c9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.374023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e4d3-7c91-4a9b-8325-578bfdd41fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.374597 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e4d3-7c91-4a9b-8325-578bfdd41fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.374872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e4d3-7c91-4a9b-8325-578bfdd41fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.375143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e4d3-7c91-4a9b-8325-578bfdd41fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.375775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e4d3-7c91-4a9b-8325-578bfdd41fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.377411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e4d3-7c91-4a9b-8325-578bfdd41fe3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.393117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1163/2334] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:33:04.397631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e4d3-7c91-4a9b-8325-578bfdd41fe3 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.407449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e4d3-7c91-4a9b-8325-578bfdd41fe3 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.412102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839ff8c-3f8b-488e-950b-5d0d21ac1bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.412731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839ff8c-3f8b-488e-950b-5d0d21ac1bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.412991 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839ff8c-3f8b-488e-950b-5d0d21ac1bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.413260 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839ff8c-3f8b-488e-950b-5d0d21ac1bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.413893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839ff8c-3f8b-488e-950b-5d0d21ac1bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.415490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839ff8c-3f8b-488e-950b-5d0d21ac1bf6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.425927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1164/2335] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:33:04.430237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839ff8c-3f8b-488e-950b-5d0d21ac1bf6 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.440232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1172/2336] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:04.441485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839ff8c-3f8b-488e-950b-5d0d21ac1bf6 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.443122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140935fa-703a-4719-ad11-1545eee24976 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.447448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfe7b7-9a79-4d2c-86a2-5b88cceb9241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.448164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe7b7-9a79-4d2c-86a2-5b88cceb9241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.453666 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe7b7-9a79-4d2c-86a2-5b88cceb9241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.453666 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe7b7-9a79-4d2c-86a2-5b88cceb9241 admin admin] PATH_INFO: `/v3/projects/475cd286bbe246409f13d1ba43d11dc4/users/4d6e2fea3aeb479685e6f9dbaf6b5dea/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.455574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140935fa-703a-4719-ad11-1545eee24976 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.460824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1e524-6f15-4ad1-81e6-9b4215575d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.461428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e524-6f15-4ad1-81e6-9b4215575d35 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.461706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e524-6f15-4ad1-81e6-9b4215575d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.461974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e524-6f15-4ad1-81e6-9b4215575d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.462607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1e524-6f15-4ad1-81e6-9b4215575d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.464594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1e524-6f15-4ad1-81e6-9b4215575d35 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.464907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfe7b7-9a79-4d2c-86a2-5b88cceb9241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475cd286bbe246409f13d1ba43d11dc4, user_id=4d6e2fea3aeb479685e6f9dbaf6b5dea, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.467645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfe7b7-9a79-4d2c-86a2-5b88cceb9241 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.477973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:04.560293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1165/2337] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:04 2022] PUT /identity/v3/projects/475cd286bbe246409f13d1ba43d11dc4/users/4d6e2fea3aeb479685e6f9dbaf6b5dea/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:04.565548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314ee07-01ca-4fcf-aa26-13c9c11d04b5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.565837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314ee07-01ca-4fcf-aa26-13c9c11d04b5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.566112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314ee07-01ca-4fcf-aa26-13c9c11d04b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.592302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a314ee07-01ca-4fcf-aa26-13c9c11d04b5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:04.592302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a314ee07-01ca-4fcf-aa26-13c9c11d04b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:04.598110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1173/2338] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:04 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:04.602648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1e524-6f15-4ad1-81e6-9b4215575d35 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.661590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:04.686083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1166/2339] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:33:04.693827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1e524-6f15-4ad1-81e6-9b4215575d35 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.697376 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314ee07-01ca-4fcf-aa26-13c9c11d04b5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.698980 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a314ee07-01ca-4fcf-aa26-13c9c11d04b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:04.704910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba1628-6805-42e0-b58a-341a6f0d5532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.705624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba1628-6805-42e0-b58a-341a6f0d5532 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.705971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba1628-6805-42e0-b58a-341a6f0d5532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.706313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba1628-6805-42e0-b58a-341a6f0d5532 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.706989 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba1628-6805-42e0-b58a-341a6f0d5532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.708988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba1628-6805-42e0-b58a-341a6f0d5532 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.796556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314ee07-01ca-4fcf-aa26-13c9c11d04b5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.834119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1174/2340] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:04 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:33:04.843537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba1628-6805-42e0-b58a-341a6f0d5532 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.857081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba1628-6805-42e0-b58a-341a6f0d5532 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.873800 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5efbb-4a21-4439-8c82-42ddc984296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.875245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5efbb-4a21-4439-8c82-42ddc984296d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.875245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5efbb-4a21-4439-8c82-42ddc984296d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.875245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5efbb-4a21-4439-8c82-42ddc984296d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.875924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5efbb-4a21-4439-8c82-42ddc984296d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.880108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5efbb-4a21-4439-8c82-42ddc984296d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.898062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1175/2341] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:04.900200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5efbb-4a21-4439-8c82-42ddc984296d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:04.912721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5efbb-4a21-4439-8c82-42ddc984296d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:04.914070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4624f-9dae-4750-9377-a14be6c77c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.914724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4624f-9dae-4750-9377-a14be6c77c49 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.915006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4624f-9dae-4750-9377-a14be6c77c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.915317 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4624f-9dae-4750-9377-a14be6c77c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.920047 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ffe33-dbb3-4014-ad29-c2fd0e36b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:04.920909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ffe33-dbb3-4014-ad29-c2fd0e36b08e admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:04.921195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ffe33-dbb3-4014-ad29-c2fd0e36b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:04.921548 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ffe33-dbb3-4014-ad29-c2fd0e36b08e admin admin] PATH_INFO: `/v3/projects/467df3c09b8f482892bed676f6449a96/users/47609b6b51e74011b244445b9efdb840/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:04.932803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4624f-9dae-4750-9377-a14be6c77c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.934520 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4624f-9dae-4750-9377-a14be6c77c49 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.939918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ffe33-dbb3-4014-ad29-c2fd0e36b08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=467df3c09b8f482892bed676f6449a96, user_id=47609b6b51e74011b244445b9efdb840, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:04.943225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ffe33-dbb3-4014-ad29-c2fd0e36b08e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:04.947169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1167/2342] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:33:05.031626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1176/2343] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:04 2022] PUT /identity/v3/projects/467df3c09b8f482892bed676f6449a96/users/47609b6b51e74011b244445b9efdb840/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:05.035907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4624f-9dae-4750-9377-a14be6c77c49 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:05.045716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4624f-9dae-4750-9377-a14be6c77c49 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:05.103924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f4236-940e-4ab2-bd1e-b1f06e095185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:05.104564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f4236-940e-4ab2-bd1e-b1f06e095185 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:05.104844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f4236-940e-4ab2-bd1e-b1f06e095185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:05.105114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f4236-940e-4ab2-bd1e-b1f06e095185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:05.105781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f4236-940e-4ab2-bd1e-b1f06e095185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:05.107438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f4236-940e-4ab2-bd1e-b1f06e095185 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:05.126291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1168/2344] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:05.127413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ffe33-dbb3-4014-ad29-c2fd0e36b08e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:05.143715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ffe33-dbb3-4014-ad29-c2fd0e36b08e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:05.149609 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff41a0-ca80-49fb-8eb1-83350a3e7aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:05.150221 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff41a0-ca80-49fb-8eb1-83350a3e7aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:05.150503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff41a0-ca80-49fb-8eb1-83350a3e7aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:05.150781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff41a0-ca80-49fb-8eb1-83350a3e7aa4 admin admin] PATH_INFO: `/v3/projects/467df3c09b8f482892bed676f6449a96/users/47609b6b51e74011b244445b9efdb840/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:05.152765 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff41a0-ca80-49fb-8eb1-83350a3e7aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467df3c09b8f482892bed676f6449a96, user_id=47609b6b51e74011b244445b9efdb840, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:05.155443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff41a0-ca80-49fb-8eb1-83350a3e7aa4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:05.175973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1177/2345] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:05 2022] PUT /identity/v3/projects/467df3c09b8f482892bed676f6449a96/users/47609b6b51e74011b244445b9efdb840/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:05.179667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181acf36-f324-4c95-bf31-146a79c8ed88 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:05.179667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181acf36-f324-4c95-bf31-146a79c8ed88 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:05.179667 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181acf36-f324-4c95-bf31-146a79c8ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:05.217142 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-181acf36-f324-4c95-bf31-146a79c8ed88 None None] MFA Rules not processed for user `47609b6b51e74011b244445b9efdb840`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:05.218567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-181acf36-f324-4c95-bf31-146a79c8ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:05.308069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1169/2346] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:05.312905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:05.320306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff41a0-ca80-49fb-8eb1-83350a3e7aa4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:05.383797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff41a0-ca80-49fb-8eb1-83350a3e7aa4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:05.387787 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbb775-f12d-45d9-8c1c-15ea7ec5d11c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:05.388422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbb775-f12d-45d9-8c1c-15ea7ec5d11c service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:05.388696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbb775-f12d-45d9-8c1c-15ea7ec5d11c service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:05.388964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbb775-f12d-45d9-8c1c-15ea7ec5d11c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:05.391658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:05.398748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbb775-f12d-45d9-8c1c-15ea7ec5d11c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:05.400338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbb775-f12d-45d9-8c1c-15ea7ec5d11c service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:05.409714 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1178/2347] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:33:05.809325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181acf36-f324-4c95-bf31-146a79c8ed88 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:05.899782 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181acf36-f324-4c95-bf31-146a79c8ed88 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:05.904523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:05.905148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:05.905425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:05.905708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] PATH_INFO: `/v3/users/33e8cb7821f24df98972c8e7a9468a60` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:05.906814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e8cb7821f24df98972c8e7a9468a60)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:05.908783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:06.143446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e8cb7821f24df98972c8e7a9468a60'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:06.144161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e8cb7821f24df98972c8e7a9468a60'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:06.148929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:06.164733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e8cb7821f24df98972c8e7a9468a60'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:06.172471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e8cb7821f24df98972c8e7a9468a60'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:06.294615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbb775-f12d-45d9-8c1c-15ea7ec5d11c service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:06.296036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1350de34-04df-4a48-8163-da02f4feb8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e8cb7821f24df98972c8e7a9468a60'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:06.298105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-17dbb775-f12d-45d9-8c1c-15ea7ec5d11c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:06.303484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1170/2348] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:05 2022] DELETE /identity/v3/users/33e8cb7821f24df98972c8e7a9468a60 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:06.308102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39678f70-b568-462f-bb03-35a9fb283d92 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:06.308473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39678f70-b568-462f-bb03-35a9fb283d92 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:06.308662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39678f70-b568-462f-bb03-35a9fb283d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:06.331974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbb775-f12d-45d9-8c1c-15ea7ec5d11c service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:06.360857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-39678f70-b568-462f-bb03-35a9fb283d92 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:06.362181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-39678f70-b568-462f-bb03-35a9fb283d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:06.400633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:06.401268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:06.401545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:06.401816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] PATH_INFO: `/v3/users/0a4264979239468c86325ed2999e457b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:06.404358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4264979239468c86325ed2999e457b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:06.406293 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:06.459322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1171/2349] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:06.474064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39678f70-b568-462f-bb03-35a9fb283d92 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:06.474064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-39678f70-b568-462f-bb03-35a9fb283d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:06.561241 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39678f70-b568-462f-bb03-35a9fb283d92 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:06.565804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aac6a-57a0-4956-b04d-b06f2a27e496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:06.566587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aac6a-57a0-4956-b04d-b06f2a27e496 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:06.566936 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aac6a-57a0-4956-b04d-b06f2a27e496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:06.567476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aac6a-57a0-4956-b04d-b06f2a27e496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:06.581572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aac6a-57a0-4956-b04d-b06f2a27e496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:06.584226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aac6a-57a0-4956-b04d-b06f2a27e496 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:06.593850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1172/2350] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:06.641158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4264979239468c86325ed2999e457b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:07.017032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4264979239468c86325ed2999e457b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:07.025865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4264979239468c86325ed2999e457b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:07.029862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4264979239468c86325ed2999e457b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:07.039595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4264979239468c86325ed2999e457b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:07.046020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1179/2351] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:06 2022] DELETE /identity/v3/users/0a4264979239468c86325ed2999e457b => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:07.052913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1221-d480-4265-aede-2d3f0296fb86 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:07.059641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1221-d480-4265-aede-2d3f0296fb86 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:07.059641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1221-d480-4265-aede-2d3f0296fb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:07.080302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:07.099950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-961f1221-d480-4265-aede-2d3f0296fb86 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:07.101918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-961f1221-d480-4265-aede-2d3f0296fb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:07.244282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1173/2352] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:07.255479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:07.257562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:07.316680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f1221-d480-4265-aede-2d3f0296fb86 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:07.319396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-961f1221-d480-4265-aede-2d3f0296fb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:07.359038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f1221-d480-4265-aede-2d3f0296fb86 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:07.371612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:07.372601 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:07.373088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:07.373625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] PATH_INFO: `/v3/projects/75bb97ffbcce4af1b513cb0299ce9494` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:07.375371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=75bb97ffbcce4af1b513cb0299ce9494)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:07.377753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:07.386674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d8c99-5f14-4c6d-b7fd-744780ddbf1d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:07.391541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364da42-a7c6-4ad5-9be5-c9d36aba7969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:07.392537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364da42-a7c6-4ad5-9be5-c9d36aba7969 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:07.392966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364da42-a7c6-4ad5-9be5-c9d36aba7969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:07.393512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364da42-a7c6-4ad5-9be5-c9d36aba7969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:07.410396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364da42-a7c6-4ad5-9be5-c9d36aba7969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:07.411541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364da42-a7c6-4ad5-9be5-c9d36aba7969 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:07.423268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1180/2353] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:07.521178 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:07.593147 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75bb97ffbcce4af1b513cb0299ce9494', 'request_id': 'req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:07.637649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75bb97ffbcce4af1b513cb0299ce9494', 'request_id': 'req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:07.640139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75bb97ffbcce4af1b513cb0299ce9494', 'request_id': 'req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:07.735746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] The token cache is being invalidate because project 75bb97ffbcce4af1b513cb0299ce9494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:07.735746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:07.735746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:07.740365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1174/2354] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:07 2022] DELETE /identity/v3/projects/75bb97ffbcce4af1b513cb0299ce9494 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:07.745159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364da42-a7c6-4ad5-9be5-c9d36aba7969 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:07.788576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364da42-a7c6-4ad5-9be5-c9d36aba7969 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:07.917130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:07.917775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:07.918054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:07.918328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] PATH_INFO: `/v3/users/52924a5c9f244e6ea42cc9d21d85e2ff` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:07.920208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52924a5c9f244e6ea42cc9d21d85e2ff)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:07.922943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:08.119545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52924a5c9f244e6ea42cc9d21d85e2ff'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:08.150907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:08.150907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:08.160612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae68dfb-9813-4c8e-b4ba-15908a5c8c7d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:08.166128 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:08.166767 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:08.167217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:08.167648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] PATH_INFO: `/v3/projects/da2df764bd0a40b091f46a172de340dd` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:08.169131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2df764bd0a40b091f46a172de340dd)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:08.171463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:08.199275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52924a5c9f244e6ea42cc9d21d85e2ff'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:08.218162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52924a5c9f244e6ea42cc9d21d85e2ff'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:08.219904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52924a5c9f244e6ea42cc9d21d85e2ff'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:08.234865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52924a5c9f244e6ea42cc9d21d85e2ff'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:08.241977 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1181/2355] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:07 2022] DELETE /identity/v3/users/52924a5c9f244e6ea42cc9d21d85e2ff => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:08.325617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2df764bd0a40b091f46a172de340dd', 'request_id': 'req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:08.342143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2df764bd0a40b091f46a172de340dd', 'request_id': 'req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:08.352812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2df764bd0a40b091f46a172de340dd', 'request_id': 'req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:08.502736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] The token cache is being invalidate because project da2df764bd0a40b091f46a172de340dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:08.502736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:08.502736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3454a5f7-a1c6-4cb3-94d2-01ce49e7e5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:08.522387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1175/2356] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:08 2022] DELETE /identity/v3/projects/da2df764bd0a40b091f46a172de340dd => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:08.821068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:08.918295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:08.919804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:08.995533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:09.035552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa0b9d-8fc7-4a30-85e0-7230b7350d6c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:09.136927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:09.137856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:09.138309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:09.138769 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] PATH_INFO: `/v3/projects/c08be4e3ceb94f9ab2415f9dffc1feb2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:09.140820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08be4e3ceb94f9ab2415f9dffc1feb2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:09.143556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:09.297228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08be4e3ceb94f9ab2415f9dffc1feb2', 'request_id': 'req-75d867b0-ac47-407e-8d79-19437d03504e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:09.304927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08be4e3ceb94f9ab2415f9dffc1feb2', 'request_id': 'req-75d867b0-ac47-407e-8d79-19437d03504e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:09.313334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08be4e3ceb94f9ab2415f9dffc1feb2', 'request_id': 'req-75d867b0-ac47-407e-8d79-19437d03504e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:09.431405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] The token cache is being invalidate because project c08be4e3ceb94f9ab2415f9dffc1feb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:09.431700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:09.439264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-75d867b0-ac47-407e-8d79-19437d03504e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:09.444982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1182/2357] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:08 2022] DELETE /identity/v3/projects/c08be4e3ceb94f9ab2415f9dffc1feb2 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:09.446378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68879dde-568c-460c-b98f-dee8e966fb79 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:09.447224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68879dde-568c-460c-b98f-dee8e966fb79 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:09.447707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68879dde-568c-460c-b98f-dee8e966fb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:09.480393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-68879dde-568c-460c-b98f-dee8e966fb79 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:09.483141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-68879dde-568c-460c-b98f-dee8e966fb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:09.606200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1176/2358] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:09.614062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e35ca-aa88-473a-b74e-c25a003fcd05 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:09.614371 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e35ca-aa88-473a-b74e-c25a003fcd05 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:09.614849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e35ca-aa88-473a-b74e-c25a003fcd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:09.637925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2c0e35ca-aa88-473a-b74e-c25a003fcd05 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:09.639238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2c0e35ca-aa88-473a-b74e-c25a003fcd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:09.647683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1183/2359] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:09.651942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68879dde-568c-460c-b98f-dee8e966fb79 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:09.661999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68879dde-568c-460c-b98f-dee8e966fb79 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:09.667567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a8597-78fd-472a-9294-b120a3fbe7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:09.668232 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a8597-78fd-472a-9294-b120a3fbe7be admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:09.668518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a8597-78fd-472a-9294-b120a3fbe7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:09.668787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a8597-78fd-472a-9294-b120a3fbe7be admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:09.669685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a8597-78fd-472a-9294-b120a3fbe7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:09.670063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a8597-78fd-472a-9294-b120a3fbe7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:09.671929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a8597-78fd-472a-9294-b120a3fbe7be admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:09.685735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1177/2360] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:33:09.690006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e35ca-aa88-473a-b74e-c25a003fcd05 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:09.699994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e35ca-aa88-473a-b74e-c25a003fcd05 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:09.705054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a02f1-a547-4cfc-810f-cdbe59b250c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:09.705660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a02f1-a547-4cfc-810f-cdbe59b250c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:09.706043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a02f1-a547-4cfc-810f-cdbe59b250c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:09.706312 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a02f1-a547-4cfc-810f-cdbe59b250c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:09.706945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a02f1-a547-4cfc-810f-cdbe59b250c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:09.708906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a02f1-a547-4cfc-810f-cdbe59b250c9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:09.870896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1184/2361] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:09 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:09.871643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a8597-78fd-472a-9294-b120a3fbe7be admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:09.881822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a8597-78fd-472a-9294-b120a3fbe7be admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:09.922627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a02f1-a547-4cfc-810f-cdbe59b250c9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:09.924854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b13a02f1-a547-4cfc-810f-cdbe59b250c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:10.002037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f9837-5cdf-485e-8e12-ae858b803729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:10.015874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f9837-5cdf-485e-8e12-ae858b803729 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:10.015874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f9837-5cdf-485e-8e12-ae858b803729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:10.015874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f9837-5cdf-485e-8e12-ae858b803729 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:10.015874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f9837-5cdf-485e-8e12-ae858b803729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:10.015874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f9837-5cdf-485e-8e12-ae858b803729 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:10.063413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a02f1-a547-4cfc-810f-cdbe59b250c9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:10.071421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:10.072712 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:10.073075 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:10.073382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] PATH_INFO: `/v3/users/0298dd40cfe64e34bfdd5ca83bd8da79` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:10.075229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0298dd40cfe64e34bfdd5ca83bd8da79)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:10.077386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:10.107782 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1178/2362] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:09 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:33:10.107969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f9837-5cdf-485e-8e12-ae858b803729 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:10.126821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f9837-5cdf-485e-8e12-ae858b803729 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:10.133346 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50cc53-b08d-49c3-b886-4eebda464dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:10.134050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50cc53-b08d-49c3-b886-4eebda464dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:10.134415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50cc53-b08d-49c3-b886-4eebda464dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:10.134853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50cc53-b08d-49c3-b886-4eebda464dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:10.135717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50cc53-b08d-49c3-b886-4eebda464dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:10.138188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50cc53-b08d-49c3-b886-4eebda464dbe admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:10.155421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1179/2363] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:10.159571 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50cc53-b08d-49c3-b886-4eebda464dbe admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:10.177611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50cc53-b08d-49c3-b886-4eebda464dbe admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:10.183427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc73ea-d5f6-4792-b924-bf0d47f55610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:10.184081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc73ea-d5f6-4792-b924-bf0d47f55610 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:10.184362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc73ea-d5f6-4792-b924-bf0d47f55610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:10.184639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc73ea-d5f6-4792-b924-bf0d47f55610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:10.185831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc73ea-d5f6-4792-b924-bf0d47f55610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:10.191133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc73ea-d5f6-4792-b924-bf0d47f55610 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:10.207137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1180/2364] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:33:10.208196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc73ea-d5f6-4792-b924-bf0d47f55610 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:10.223482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc73ea-d5f6-4792-b924-bf0d47f55610 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:10.231670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0df27-bc8b-42b9-8316-abe188506967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:10.232397 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0df27-bc8b-42b9-8316-abe188506967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:10.232694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0df27-bc8b-42b9-8316-abe188506967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:10.232974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0df27-bc8b-42b9-8316-abe188506967 admin admin] PATH_INFO: `/v3/projects/598e444e7a7f42d7a1f70e1f98fd1330/users/2ca8a5d5c23c4d81b21bc4a69afe8e86/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:10.253395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0df27-bc8b-42b9-8316-abe188506967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598e444e7a7f42d7a1f70e1f98fd1330, user_id=2ca8a5d5c23c4d81b21bc4a69afe8e86, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:10.258331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0df27-bc8b-42b9-8316-abe188506967 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:10.336510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0298dd40cfe64e34bfdd5ca83bd8da79'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:10.389553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1181/2365] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:10 2022] PUT /identity/v3/projects/598e444e7a7f42d7a1f70e1f98fd1330/users/2ca8a5d5c23c4d81b21bc4a69afe8e86/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:10.438756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0298dd40cfe64e34bfdd5ca83bd8da79'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:10.454731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0298dd40cfe64e34bfdd5ca83bd8da79'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:10.459675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0298dd40cfe64e34bfdd5ca83bd8da79'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:10.461522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075168f-4a0f-42ab-8f55-1e23facb4c41 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:10.464236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075168f-4a0f-42ab-8f55-1e23facb4c41 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:10.464236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075168f-4a0f-42ab-8f55-1e23facb4c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:10.483426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b8f5b1a5-13c5-46d9-a55e-9c628bd68343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0298dd40cfe64e34bfdd5ca83bd8da79'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:10.494701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1185/2366] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:09 2022] DELETE /identity/v3/users/0298dd40cfe64e34bfdd5ca83bd8da79 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:10.496674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72494111-54ed-4f58-8355-44ce851729ab None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:10.497148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72494111-54ed-4f58-8355-44ce851729ab None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:10.497603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72494111-54ed-4f58-8355-44ce851729ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:10.526235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-72494111-54ed-4f58-8355-44ce851729ab None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:10.528487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-72494111-54ed-4f58-8355-44ce851729ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:10.536868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d075168f-4a0f-42ab-8f55-1e23facb4c41 None None] MFA Rules not processed for user `2ca8a5d5c23c4d81b21bc4a69afe8e86`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:10.538679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d075168f-4a0f-42ab-8f55-1e23facb4c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:10.631775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1186/2367] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:10.639101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1182/2368] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:33:10.641603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72494111-54ed-4f58-8355-44ce851729ab None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:10.641603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-72494111-54ed-4f58-8355-44ce851729ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:10.656462 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075168f-4a0f-42ab-8f55-1e23facb4c41 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:10.660201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d075168f-4a0f-42ab-8f55-1e23facb4c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:10.710967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72494111-54ed-4f58-8355-44ce851729ab None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:10.715614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfa657-4884-49b8-b2eb-abc17fe2e138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:10.716350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa657-4884-49b8-b2eb-abc17fe2e138 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:10.716692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa657-4884-49b8-b2eb-abc17fe2e138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:10.717053 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa657-4884-49b8-b2eb-abc17fe2e138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:10.727631 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfa657-4884-49b8-b2eb-abc17fe2e138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:10.729117 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfa657-4884-49b8-b2eb-abc17fe2e138 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:10.733090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075168f-4a0f-42ab-8f55-1e23facb4c41 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:10.736959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25dd15-d2fb-4f3c-9271-65a0e668d2ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6267b159204df7af8a4f84d227f88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:10.737563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dd15-d2fb-4f3c-9271-65a0e668d2ad service glance] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:10.737834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dd15-d2fb-4f3c-9271-65a0e668d2ad service glance] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:10.738098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dd15-d2fb-4f3c-9271-65a0e668d2ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:10.738853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1187/2369] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:10.751855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25dd15-d2fb-4f3c-9271-65a0e668d2ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:10.753259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25dd15-d2fb-4f3c-9271-65a0e668d2ad service glance] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:10.765795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1183/2370] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:33:11.332431 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfa657-4884-49b8-b2eb-abc17fe2e138 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:11.339080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-57bfa657-4884-49b8-b2eb-abc17fe2e138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:11.372327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfa657-4884-49b8-b2eb-abc17fe2e138 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:11.385393 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:11.386452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:11.395783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:11.396432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] PATH_INFO: `/v3/projects/f280ed3e8b394e40bfb5a456af6ee993` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:11.398084 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f280ed3e8b394e40bfb5a456af6ee993)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:11.400667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:11.565721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f280ed3e8b394e40bfb5a456af6ee993', 'request_id': 'req-03cf46c6-2ca1-494d-8f7e-7156d8489079'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:11.574915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f280ed3e8b394e40bfb5a456af6ee993', 'request_id': 'req-03cf46c6-2ca1-494d-8f7e-7156d8489079'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:11.586849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f280ed3e8b394e40bfb5a456af6ee993', 'request_id': 'req-03cf46c6-2ca1-494d-8f7e-7156d8489079'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:11.649094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:11.699281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] The token cache is being invalidate because project f280ed3e8b394e40bfb5a456af6ee993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:11.699641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:11.700445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-03cf46c6-2ca1-494d-8f7e-7156d8489079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:11.702433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1188/2371] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:11 2022] DELETE /identity/v3/projects/f280ed3e8b394e40bfb5a456af6ee993 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:11.706322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25dd15-d2fb-4f3c-9271-65a0e668d2ad service glance] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:11.720612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25dd15-d2fb-4f3c-9271-65a0e668d2ad service glance] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:11.787864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:11.804729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:11.805626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:11.806158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:11.806585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] PATH_INFO: `/v3/users/47609b6b51e74011b244445b9efdb840` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:11.808283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47609b6b51e74011b244445b9efdb840)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:11.810493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:12.038328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47609b6b51e74011b244445b9efdb840'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:12.042107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47609b6b51e74011b244445b9efdb840'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:12.070314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47609b6b51e74011b244445b9efdb840'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:12.080973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47609b6b51e74011b244445b9efdb840'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:12.227395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47609b6b51e74011b244445b9efdb840'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:12.234798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1184/2372] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:11 2022] DELETE /identity/v3/users/47609b6b51e74011b244445b9efdb840 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:12.272287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0dd66-603f-4bc0-8356-9d0edeab0517 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:12.272595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0dd66-603f-4bc0-8356-9d0edeab0517 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:12.272823 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0dd66-603f-4bc0-8356-9d0edeab0517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:12.314237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3ee0dd66-603f-4bc0-8356-9d0edeab0517 None None] MFA Rules not processed for user `4d6e2fea3aeb479685e6f9dbaf6b5dea`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:12.315624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3ee0dd66-603f-4bc0-8356-9d0edeab0517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:12.414789 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1189/2373] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:12.417782 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:12.420129 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:12.494532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92f74-1871-4ca4-98ac-0da04de99411 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:12.499458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b7f93-b964-4a30-829e-f3f30ead9382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:12.500672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b7f93-b964-4a30-829e-f3f30ead9382 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:12.500672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b7f93-b964-4a30-829e-f3f30ead9382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:12.500850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b7f93-b964-4a30-829e-f3f30ead9382 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:12.501534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b7f93-b964-4a30-829e-f3f30ead9382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:12.503637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b7f93-b964-4a30-829e-f3f30ead9382 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:12.629611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1185/2374] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:12 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:12.630639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0dd66-603f-4bc0-8356-9d0edeab0517 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:12.666104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0dd66-603f-4bc0-8356-9d0edeab0517 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:12.779639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f5cc0-7e9f-43b5-8e54-43d35fc277e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:12.780284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f5cc0-7e9f-43b5-8e54-43d35fc277e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:12.780567 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f5cc0-7e9f-43b5-8e54-43d35fc277e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:12.780839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f5cc0-7e9f-43b5-8e54-43d35fc277e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:12.781462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f5cc0-7e9f-43b5-8e54-43d35fc277e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:12.783401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f5cc0-7e9f-43b5-8e54-43d35fc277e3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:12.804618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b7f93-b964-4a30-829e-f3f30ead9382 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:12.807559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7b2b7f93-b964-4a30-829e-f3f30ead9382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:12.829602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b7f93-b964-4a30-829e-f3f30ead9382 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:12.836020 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:12.836854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:12.837672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:12.838165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] PATH_INFO: `/v3/projects/467df3c09b8f482892bed676f6449a96` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:12.840191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=467df3c09b8f482892bed676f6449a96)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:12.842911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:12.888429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1190/2375] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:12 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:33:12.891976 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f5cc0-7e9f-43b5-8e54-43d35fc277e3 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:12.903799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f5cc0-7e9f-43b5-8e54-43d35fc277e3 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:12.911182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d92c5-5d80-4131-a0fd-c29e51c3c215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:12.913766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d92c5-5d80-4131-a0fd-c29e51c3c215 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:12.913766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d92c5-5d80-4131-a0fd-c29e51c3c215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:12.913766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d92c5-5d80-4131-a0fd-c29e51c3c215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:12.915450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d92c5-5d80-4131-a0fd-c29e51c3c215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:12.918257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d92c5-5d80-4131-a0fd-c29e51c3c215 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:12.936767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1191/2376] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:33:12.940952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d92c5-5d80-4131-a0fd-c29e51c3c215 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:12.953303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d92c5-5d80-4131-a0fd-c29e51c3c215 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:12.980894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467df3c09b8f482892bed676f6449a96', 'request_id': 'req-e379984f-32b7-4f55-91e5-4a972ce8e77e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:12.988921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467df3c09b8f482892bed676f6449a96', 'request_id': 'req-e379984f-32b7-4f55-91e5-4a972ce8e77e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:12.996699 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467df3c09b8f482892bed676f6449a96', 'request_id': 'req-e379984f-32b7-4f55-91e5-4a972ce8e77e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:13.028390 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b8434-bc6d-4e99-b5ec-bf81656b31dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:13.033165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b8434-bc6d-4e99-b5ec-bf81656b31dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:13.033165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b8434-bc6d-4e99-b5ec-bf81656b31dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:13.033165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b8434-bc6d-4e99-b5ec-bf81656b31dc admin admin] PATH_INFO: `/v3/projects/e609ac813be142cb9b3d0ca4378c856c/users/6ff415d9fc54474180bb143881a5da02/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:13.045537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b8434-bc6d-4e99-b5ec-bf81656b31dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e609ac813be142cb9b3d0ca4378c856c, user_id=6ff415d9fc54474180bb143881a5da02, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:13.048227 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b8434-bc6d-4e99-b5ec-bf81656b31dc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:13.073957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] The token cache is being invalidate because project 467df3c09b8f482892bed676f6449a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:13.074245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:13.074903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e379984f-32b7-4f55-91e5-4a972ce8e77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:13.076495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1186/2377] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:12 2022] DELETE /identity/v3/projects/467df3c09b8f482892bed676f6449a96 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:13.081676 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ba322-15f8-4821-985f-d927d59c0b4c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:13.082025 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ba322-15f8-4821-985f-d927d59c0b4c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:13.082307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ba322-15f8-4821-985f-d927d59c0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:13.119789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1a6ba322-15f8-4821-985f-d927d59c0b4c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:13.119789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1a6ba322-15f8-4821-985f-d927d59c0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:13.119983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1192/2378] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:12 2022] PUT /identity/v3/projects/e609ac813be142cb9b3d0ca4378c856c/users/6ff415d9fc54474180bb143881a5da02/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:13.122119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b8434-bc6d-4e99-b5ec-bf81656b31dc admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:13.123807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1187/2379] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:33:13.124686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b84b8434-bc6d-4e99-b5ec-bf81656b31dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:13.132007 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad3a0c-a3ca-4659-a5a8-c8f1cc9b87d1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:13.132296 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad3a0c-a3ca-4659-a5a8-c8f1cc9b87d1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:13.132803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad3a0c-a3ca-4659-a5a8-c8f1cc9b87d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:13.164936 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b9ad3a0c-a3ca-4659-a5a8-c8f1cc9b87d1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:13.166724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b9ad3a0c-a3ca-4659-a5a8-c8f1cc9b87d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:13.195467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:13.235140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b8434-bc6d-4e99-b5ec-bf81656b31dc admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:13.243247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc55ee-4524-40b8-8bb5-eb1e0b101854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:13.243904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc55ee-4524-40b8-8bb5-eb1e0b101854 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:13.244190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc55ee-4524-40b8-8bb5-eb1e0b101854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:13.244464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc55ee-4524-40b8-8bb5-eb1e0b101854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:13.245117 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc55ee-4524-40b8-8bb5-eb1e0b101854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:13.248001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc55ee-4524-40b8-8bb5-eb1e0b101854 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:13.262995 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1193/2380] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:33:13.267574 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1188/2381] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:33:13.267846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc55ee-4524-40b8-8bb5-eb1e0b101854 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:13.273347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad3a0c-a3ca-4659-a5a8-c8f1cc9b87d1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:13.280543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc55ee-4524-40b8-8bb5-eb1e0b101854 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:13.284521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad3a0c-a3ca-4659-a5a8-c8f1cc9b87d1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:13.286339 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc0dc9-eaf5-4bd9-80dc-945d30800987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:13.287332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc0dc9-eaf5-4bd9-80dc-945d30800987 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:13.287657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc0dc9-eaf5-4bd9-80dc-945d30800987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:13.288252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc0dc9-eaf5-4bd9-80dc-945d30800987 admin admin] PATH_INFO: `/v3/projects/e609ac813be142cb9b3d0ca4378c856c/users/6ff415d9fc54474180bb143881a5da02/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:13.289406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0437a-b5f1-4410-ba82-3179c2975cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:13.290069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0437a-b5f1-4410-ba82-3179c2975cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:13.290360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0437a-b5f1-4410-ba82-3179c2975cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:13.290526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc0dc9-eaf5-4bd9-80dc-945d30800987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e609ac813be142cb9b3d0ca4378c856c, user_id=6ff415d9fc54474180bb143881a5da02, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:13.290609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0437a-b5f1-4410-ba82-3179c2975cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:13.291711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0437a-b5f1-4410-ba82-3179c2975cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:13.292058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0437a-b5f1-4410-ba82-3179c2975cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:13.293755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0437a-b5f1-4410-ba82-3179c2975cdc admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:13.293864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc0dc9-eaf5-4bd9-80dc-945d30800987 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:13.306540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1194/2382] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:13 2022] PUT /identity/v3/projects/e609ac813be142cb9b3d0ca4378c856c/users/6ff415d9fc54474180bb143881a5da02/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:13.307125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1189/2383] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:33:13.312565 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc0dc9-eaf5-4bd9-80dc-945d30800987 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:13.396603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc0dc9-eaf5-4bd9-80dc-945d30800987 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:13.423726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d539ae-0cc6-451d-81dd-ae89de15b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:13.423726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d539ae-0cc6-451d-81dd-ae89de15b17d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:13.424573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d539ae-0cc6-451d-81dd-ae89de15b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:13.424573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d539ae-0cc6-451d-81dd-ae89de15b17d admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:13.424839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d539ae-0cc6-451d-81dd-ae89de15b17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:13.426790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d539ae-0cc6-451d-81dd-ae89de15b17d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:13.603858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1195/2384] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:13 2022] POST /identity/v3/projects => generated 383 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:33:13.607962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0437a-b5f1-4410-ba82-3179c2975cdc admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:13.619411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0437a-b5f1-4410-ba82-3179c2975cdc admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:13.727091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cce64-4f3f-42e2-a427-66336ec2553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:13.728443 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cce64-4f3f-42e2-a427-66336ec2553f admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:13.728724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cce64-4f3f-42e2-a427-66336ec2553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:13.747303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cce64-4f3f-42e2-a427-66336ec2553f admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:13.747303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cce64-4f3f-42e2-a427-66336ec2553f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:13.753387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cce64-4f3f-42e2-a427-66336ec2553f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:13.905140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1190/2385] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:13 2022] POST /identity/v3/users => generated 292 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:33:13.909276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d539ae-0cc6-451d-81dd-ae89de15b17d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:13.920047 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d539ae-0cc6-451d-81dd-ae89de15b17d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:13.925030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c69e8-178d-44e2-8e2b-be7368f69fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:13.925656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c69e8-178d-44e2-8e2b-be7368f69fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:13.925928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c69e8-178d-44e2-8e2b-be7368f69fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:13.926418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c69e8-178d-44e2-8e2b-be7368f69fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:13.929422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c69e8-178d-44e2-8e2b-be7368f69fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:13.931126 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c69e8-178d-44e2-8e2b-be7368f69fd6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:13.952900 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cce64-4f3f-42e2-a427-66336ec2553f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:13.957836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1196/2386] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:13.959870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cce64-4f3f-42e2-a427-66336ec2553f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:13.964881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b133ab6-e37b-4211-8985-81181d548770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:13.965709 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b133ab6-e37b-4211-8985-81181d548770 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:13.966135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b133ab6-e37b-4211-8985-81181d548770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:13.966634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b133ab6-e37b-4211-8985-81181d548770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:13.967488 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b133ab6-e37b-4211-8985-81181d548770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:13.969733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b133ab6-e37b-4211-8985-81181d548770 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:13.985552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1191/2387] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:33:13.990235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c69e8-178d-44e2-8e2b-be7368f69fd6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:14.003562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c69e8-178d-44e2-8e2b-be7368f69fd6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:14.023846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6cea-0aa2-431d-b87d-d0f4344e05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:14.023846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6cea-0aa2-431d-b87d-d0f4344e05f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:14.023846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6cea-0aa2-431d-b87d-d0f4344e05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:14.023846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6cea-0aa2-431d-b87d-d0f4344e05f8 admin admin] PATH_INFO: `/v3/projects/ec524f8401754f04b57821d4cc186169/users/756eb229d1904e1d989b5fca81026355/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:14.047036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea6cea-0aa2-431d-b87d-d0f4344e05f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec524f8401754f04b57821d4cc186169, user_id=756eb229d1904e1d989b5fca81026355, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:14.052014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea6cea-0aa2-431d-b87d-d0f4344e05f8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:14.138106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1197/2388] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:13 2022] PUT /identity/v3/projects/ec524f8401754f04b57821d4cc186169/users/756eb229d1904e1d989b5fca81026355/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:14.140172 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6870b-804c-4f31-89ae-2e6953bec129 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:14.140464 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6870b-804c-4f31-89ae-2e6953bec129 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:14.140742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6870b-804c-4f31-89ae-2e6953bec129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:14.173495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d4b6870b-804c-4f31-89ae-2e6953bec129 None None] MFA Rules not processed for user `756eb229d1904e1d989b5fca81026355`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:14.174850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d4b6870b-804c-4f31-89ae-2e6953bec129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:14.255791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1192/2389] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:14.263308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6cea-0aa2-431d-b87d-d0f4344e05f8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:14.272312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:14.408763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6cea-0aa2-431d-b87d-d0f4344e05f8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:14.425000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d352974-0e91-475c-8b38-8d83caad6d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:14.425563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d352974-0e91-475c-8b38-8d83caad6d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:14.425563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d352974-0e91-475c-8b38-8d83caad6d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:14.425896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d352974-0e91-475c-8b38-8d83caad6d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:14.426464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d352974-0e91-475c-8b38-8d83caad6d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:14.428988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d352974-0e91-475c-8b38-8d83caad6d62 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:14.592067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1198/2390] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:14 2022] POST /identity/v3/projects => generated 387 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:14.594412 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6870b-804c-4f31-89ae-2e6953bec129 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:14.605729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6870b-804c-4f31-89ae-2e6953bec129 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:14.676492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674a2cb-66b2-4b26-bbaa-1b0adbf2157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:14.679420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a2cb-66b2-4b26-bbaa-1b0adbf2157c admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:14.679420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a2cb-66b2-4b26-bbaa-1b0adbf2157c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:14.679420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a2cb-66b2-4b26-bbaa-1b0adbf2157c admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:14.680873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674a2cb-66b2-4b26-bbaa-1b0adbf2157c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:14.683244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674a2cb-66b2-4b26-bbaa-1b0adbf2157c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:14.774634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1193/2391] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:14 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:33:14.777386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d352974-0e91-475c-8b38-8d83caad6d62 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:14.798092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d352974-0e91-475c-8b38-8d83caad6d62 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:14.803517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a71731-b418-46fc-a482-56ffb1516d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:14.804385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a71731-b418-46fc-a482-56ffb1516d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:14.805805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a71731-b418-46fc-a482-56ffb1516d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:14.806110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a71731-b418-46fc-a482-56ffb1516d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:14.806767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a71731-b418-46fc-a482-56ffb1516d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:14.808615 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a71731-b418-46fc-a482-56ffb1516d8f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:14.826033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1199/2392] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:14.828539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674a2cb-66b2-4b26-bbaa-1b0adbf2157c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:14.840409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674a2cb-66b2-4b26-bbaa-1b0adbf2157c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:14.848225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1352f6-f76f-492a-8c11-59759f84dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:14.853646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1352f6-f76f-492a-8c11-59759f84dffa admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:14.853646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1352f6-f76f-492a-8c11-59759f84dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:14.853646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1352f6-f76f-492a-8c11-59759f84dffa admin admin] PATH_INFO: `/v3/projects/93be1ae7dd054043a289e0537e226382/users/e5b1a1be7f6146588c81419f26790180/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:14.866460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1352f6-f76f-492a-8c11-59759f84dffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=93be1ae7dd054043a289e0537e226382, user_id=e5b1a1be7f6146588c81419f26790180, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:14.869497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1352f6-f76f-492a-8c11-59759f84dffa admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:14.984381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1194/2393] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:14 2022] PUT /identity/v3/projects/93be1ae7dd054043a289e0537e226382/users/e5b1a1be7f6146588c81419f26790180/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:14.988652 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a71731-b418-46fc-a482-56ffb1516d8f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:15.009138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a71731-b418-46fc-a482-56ffb1516d8f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:15.127260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ad385-8905-4fc5-9615-abe4218e2e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:15.127260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad385-8905-4fc5-9615-abe4218e2e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:15.127260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad385-8905-4fc5-9615-abe4218e2e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:15.127260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad385-8905-4fc5-9615-abe4218e2e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:15.128445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ad385-8905-4fc5-9615-abe4218e2e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:15.130247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ad385-8905-4fc5-9615-abe4218e2e0f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:15.157824 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1200/2394] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:15.165055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1352f6-f76f-492a-8c11-59759f84dffa admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:15.176046 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1352f6-f76f-492a-8c11-59759f84dffa admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:15.199756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fcf15-8de2-40ad-9cd2-b04ca44bc9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:15.206659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fcf15-8de2-40ad-9cd2-b04ca44bc9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:15.206952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fcf15-8de2-40ad-9cd2-b04ca44bc9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:15.207228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fcf15-8de2-40ad-9cd2-b04ca44bc9c6 admin admin] PATH_INFO: `/v3/projects/93be1ae7dd054043a289e0537e226382/users/e5b1a1be7f6146588c81419f26790180/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:15.216945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fcf15-8de2-40ad-9cd2-b04ca44bc9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93be1ae7dd054043a289e0537e226382, user_id=e5b1a1be7f6146588c81419f26790180, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:15.220110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fcf15-8de2-40ad-9cd2-b04ca44bc9c6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:15.257350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1195/2395] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:15 2022] PUT /identity/v3/projects/93be1ae7dd054043a289e0537e226382/users/e5b1a1be7f6146588c81419f26790180/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:15.259242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca9a3-cd6a-4e3e-8e04-419afb6ac377 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:15.259700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca9a3-cd6a-4e3e-8e04-419afb6ac377 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:15.260241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca9a3-cd6a-4e3e-8e04-419afb6ac377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:15.319960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-432ca9a3-cd6a-4e3e-8e04-419afb6ac377 None None] MFA Rules not processed for user `e5b1a1be7f6146588c81419f26790180`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:15.321372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-432ca9a3-cd6a-4e3e-8e04-419afb6ac377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:15.448754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1201/2396] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:15.460851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fcf15-8de2-40ad-9cd2-b04ca44bc9c6 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:15.468019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-590fcf15-8de2-40ad-9cd2-b04ca44bc9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:15.575263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fcf15-8de2-40ad-9cd2-b04ca44bc9c6 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:15.587957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e641254-303d-4050-ad1f-ce6ead5a0f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:15.587957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e641254-303d-4050-ad1f-ce6ead5a0f98 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:15.587957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e641254-303d-4050-ad1f-ce6ead5a0f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:15.587957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e641254-303d-4050-ad1f-ce6ead5a0f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:15.597192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e641254-303d-4050-ad1f-ce6ead5a0f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:15.598854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e641254-303d-4050-ad1f-ce6ead5a0f98 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:15.611868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1196/2397] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:33:15.664656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca9a3-cd6a-4e3e-8e04-419afb6ac377 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:15.715457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:15.772361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca9a3-cd6a-4e3e-8e04-419afb6ac377 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:15.783775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:15.784956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:15.786470 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:15.786754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] PATH_INFO: `/v3/users/756eb229d1904e1d989b5fca81026355` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:15.788563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756eb229d1904e1d989b5fca81026355)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:15.791317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:16.033313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756eb229d1904e1d989b5fca81026355'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:16.091266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756eb229d1904e1d989b5fca81026355'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:16.117257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756eb229d1904e1d989b5fca81026355'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:16.118439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756eb229d1904e1d989b5fca81026355'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:16.158316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756eb229d1904e1d989b5fca81026355'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:16.172199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1202/2398] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:15 2022] DELETE /identity/v3/users/756eb229d1904e1d989b5fca81026355 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:16.189858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951d33-c2fe-4f44-8752-5f94c14ed6bb None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:16.190392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951d33-c2fe-4f44-8752-5f94c14ed6bb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:16.190486 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951d33-c2fe-4f44-8752-5f94c14ed6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:16.216974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-23951d33-c2fe-4f44-8752-5f94c14ed6bb None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:16.218204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-23951d33-c2fe-4f44-8752-5f94c14ed6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:16.350315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1197/2399] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:16.375985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:16.375985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:16.461479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c0b3d-75ae-4f1e-9cb1-f1c7e65399f2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:16.465858 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ac318-0a35-4094-8786-0948e1c03c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:16.466573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ac318-0a35-4094-8786-0948e1c03c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:16.466855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ac318-0a35-4094-8786-0948e1c03c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:16.467127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ac318-0a35-4094-8786-0948e1c03c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:16.486474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ac318-0a35-4094-8786-0948e1c03c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:16.488935 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ac318-0a35-4094-8786-0948e1c03c78 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:16.509547 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1203/2400] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:16.979566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:17.200719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951d33-c2fe-4f44-8752-5f94c14ed6bb None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:17.202175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-23951d33-c2fe-4f44-8752-5f94c14ed6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:17.225898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951d33-c2fe-4f44-8752-5f94c14ed6bb None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:17.232884 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:17.234229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:17.234648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:17.235218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] PATH_INFO: `/v3/projects/ec524f8401754f04b57821d4cc186169` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:17.244013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec524f8401754f04b57821d4cc186169)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:17.246268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:17.466540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec524f8401754f04b57821d4cc186169', 'request_id': 'req-61405664-04c9-459c-a075-30ca63cc4f29'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:17.497345 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec524f8401754f04b57821d4cc186169', 'request_id': 'req-61405664-04c9-459c-a075-30ca63cc4f29'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:17.509056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec524f8401754f04b57821d4cc186169', 'request_id': 'req-61405664-04c9-459c-a075-30ca63cc4f29'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:17.597293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] The token cache is being invalidate because project ec524f8401754f04b57821d4cc186169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:17.597595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:17.598307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:17.605440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1198/2401] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:17 2022] DELETE /identity/v3/projects/ec524f8401754f04b57821d4cc186169 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:17.606033 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ac318-0a35-4094-8786-0948e1c03c78 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:17.646243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ac318-0a35-4094-8786-0948e1c03c78 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:17.726028 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:17.726956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:17.727409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:17.727917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] PATH_INFO: `/v3/users/e5b1a1be7f6146588c81419f26790180` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:17.729326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b1a1be7f6146588c81419f26790180)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:17.731721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:18.007372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b1a1be7f6146588c81419f26790180'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:18.108152 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b1a1be7f6146588c81419f26790180'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:18.120388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b1a1be7f6146588c81419f26790180'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:18.122860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b1a1be7f6146588c81419f26790180'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:18.144128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f1827ffb-0abf-4067-b21d-5e0a97aa40ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b1a1be7f6146588c81419f26790180'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:18.157400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1204/2402] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:17 2022] DELETE /identity/v3/users/e5b1a1be7f6146588c81419f26790180 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:18.232288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:18.869529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:18.870898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:18.894723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61405664-04c9-459c-a075-30ca63cc4f29 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:18.971592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:18.972556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:18.972981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:18.973400 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] PATH_INFO: `/v3/projects/93be1ae7dd054043a289e0537e226382` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:18.974846 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93be1ae7dd054043a289e0537e226382)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:18.978288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:19.125173 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93be1ae7dd054043a289e0537e226382', 'request_id': 'req-292e8025-1a2b-4733-a9a3-9f1420dc508b'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:19.133169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93be1ae7dd054043a289e0537e226382', 'request_id': 'req-292e8025-1a2b-4733-a9a3-9f1420dc508b'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:19.143175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93be1ae7dd054043a289e0537e226382', 'request_id': 'req-292e8025-1a2b-4733-a9a3-9f1420dc508b'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:19.175552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:19.215090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] The token cache is being invalidate because project 93be1ae7dd054043a289e0537e226382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:19.215382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:19.216214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-292e8025-1a2b-4733-a9a3-9f1420dc508b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:19.217974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1199/2403] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:18 2022] DELETE /identity/v3/projects/93be1ae7dd054043a289e0537e226382 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:19.223025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ae9aa-2a66-496e-916a-d6f25255519a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:19.223490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ae9aa-2a66-496e-916a-d6f25255519a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:19.223571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ae9aa-2a66-496e-916a-d6f25255519a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:19.245649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-779ae9aa-2a66-496e-916a-d6f25255519a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:19.246952 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-779ae9aa-2a66-496e-916a-d6f25255519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:19.320822 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1205/2404] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:33:19.329165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45842c78-c66a-4ca5-a15f-416e21c2b471 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:19.329687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45842c78-c66a-4ca5-a15f-416e21c2b471 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:19.329966 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45842c78-c66a-4ca5-a15f-416e21c2b471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:19.357566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-45842c78-c66a-4ca5-a15f-416e21c2b471 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:19.358660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-45842c78-c66a-4ca5-a15f-416e21c2b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:19.367988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1200/2405] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:19.371770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ae9aa-2a66-496e-916a-d6f25255519a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:19.386635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ae9aa-2a66-496e-916a-d6f25255519a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:19.393235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d32950-a46f-440f-a374-eeac5441731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:19.393919 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d32950-a46f-440f-a374-eeac5441731c admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:19.394200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d32950-a46f-440f-a374-eeac5441731c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:19.394473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d32950-a46f-440f-a374-eeac5441731c admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:19.397518 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d32950-a46f-440f-a374-eeac5441731c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:19.397639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d32950-a46f-440f-a374-eeac5441731c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:19.406485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d32950-a46f-440f-a374-eeac5441731c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:19.420735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1206/2406] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:33:19.425905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45842c78-c66a-4ca5-a15f-416e21c2b471 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:19.439390 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45842c78-c66a-4ca5-a15f-416e21c2b471 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:19.447703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff09d27-3f2a-4d39-9f99-589fc646a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:19.448371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff09d27-3f2a-4d39-9f99-589fc646a4ee admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:19.448700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff09d27-3f2a-4d39-9f99-589fc646a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:19.448975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff09d27-3f2a-4d39-9f99-589fc646a4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:19.449614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff09d27-3f2a-4d39-9f99-589fc646a4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:19.451551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff09d27-3f2a-4d39-9f99-589fc646a4ee admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:19.595915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1201/2407] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:19 2022] POST /identity/v3/projects => generated 393 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:19.597291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d32950-a46f-440f-a374-eeac5441731c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:19.610788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d32950-a46f-440f-a374-eeac5441731c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:19.747875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede44608-7fc3-4322-948b-6c464f689339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:19.748556 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede44608-7fc3-4322-948b-6c464f689339 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:19.748836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede44608-7fc3-4322-948b-6c464f689339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:19.749110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede44608-7fc3-4322-948b-6c464f689339 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:19.749745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede44608-7fc3-4322-948b-6c464f689339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:19.751726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede44608-7fc3-4322-948b-6c464f689339 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:19.855254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1207/2408] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:19 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:19.859139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff09d27-3f2a-4d39-9f99-589fc646a4ee admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:19.905062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff09d27-3f2a-4d39-9f99-589fc646a4ee admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:19.914649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506dbd6-72e7-470b-8f26-8304c5058b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:19.921500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506dbd6-72e7-470b-8f26-8304c5058b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:19.921500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506dbd6-72e7-470b-8f26-8304c5058b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:19.921500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506dbd6-72e7-470b-8f26-8304c5058b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:19.921500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506dbd6-72e7-470b-8f26-8304c5058b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:19.921500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506dbd6-72e7-470b-8f26-8304c5058b13 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:19.931162 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1202/2409] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:19.934924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede44608-7fc3-4322-948b-6c464f689339 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:19.944071 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:19.949983 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede44608-7fc3-4322-948b-6c464f689339 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:19.957593 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cb1f3-f7a2-4ef3-9b8a-d31ebb8c96e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:19.979798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cb1f3-f7a2-4ef3-9b8a-d31ebb8c96e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:19.980120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cb1f3-f7a2-4ef3-9b8a-d31ebb8c96e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:19.980409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cb1f3-f7a2-4ef3-9b8a-d31ebb8c96e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:19.983418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cb1f3-f7a2-4ef3-9b8a-d31ebb8c96e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:19.987703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cb1f3-f7a2-4ef3-9b8a-d31ebb8c96e5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:20.005014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1208/2410] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:20.010228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506dbd6-72e7-470b-8f26-8304c5058b13 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:20.021758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506dbd6-72e7-470b-8f26-8304c5058b13 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:20.029716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542746cf-f854-4ee0-8a04-3b4535067de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:20.030572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542746cf-f854-4ee0-8a04-3b4535067de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:20.030991 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542746cf-f854-4ee0-8a04-3b4535067de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:20.031405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542746cf-f854-4ee0-8a04-3b4535067de7 admin admin] PATH_INFO: `/v3/projects/3eeb3e70d93641839025f76e86ffb891/users/3b362759691b418289832e444e597d79/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:20.049965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542746cf-f854-4ee0-8a04-3b4535067de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eeb3e70d93641839025f76e86ffb891, user_id=3b362759691b418289832e444e597d79, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:20.054080 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542746cf-f854-4ee0-8a04-3b4535067de7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:20.154983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1203/2411] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:20 2022] PUT /identity/v3/projects/3eeb3e70d93641839025f76e86ffb891/users/3b362759691b418289832e444e597d79/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:20.167330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37e59-ba06-42f8-9896-b60a4049a2ce None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:20.170223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37e59-ba06-42f8-9896-b60a4049a2ce None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:20.170223 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37e59-ba06-42f8-9896-b60a4049a2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:20.211328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-dab37e59-ba06-42f8-9896-b60a4049a2ce None None] MFA Rules not processed for user `3b362759691b418289832e444e597d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:20.212650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dab37e59-ba06-42f8-9896-b60a4049a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:20.316338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1209/2412] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:20.317186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542746cf-f854-4ee0-8a04-3b4535067de7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:20.394177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542746cf-f854-4ee0-8a04-3b4535067de7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:20.398950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de97fef-9b4c-487d-be41-b00c7e6848f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:20.399576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de97fef-9b4c-487d-be41-b00c7e6848f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:20.399831 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de97fef-9b4c-487d-be41-b00c7e6848f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:20.400134 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de97fef-9b4c-487d-be41-b00c7e6848f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:20.400759 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de97fef-9b4c-487d-be41-b00c7e6848f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:20.402670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de97fef-9b4c-487d-be41-b00c7e6848f3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:20.520896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1204/2413] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:20 2022] POST /identity/v3/projects => generated 391 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:20.527516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab37e59-ba06-42f8-9896-b60a4049a2ce None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:20.539683 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab37e59-ba06-42f8-9896-b60a4049a2ce None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:20.631910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc73dd-59a4-4f05-8f0c-0b084040e596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:20.632667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc73dd-59a4-4f05-8f0c-0b084040e596 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:20.633024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc73dd-59a4-4f05-8f0c-0b084040e596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:20.633370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc73dd-59a4-4f05-8f0c-0b084040e596 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:20.635501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc73dd-59a4-4f05-8f0c-0b084040e596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:20.638443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc73dd-59a4-4f05-8f0c-0b084040e596 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:20.781097 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1210/2414] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:20 2022] POST /identity/v3/users => generated 302 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:20.785204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de97fef-9b4c-487d-be41-b00c7e6848f3 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:20.800637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de97fef-9b4c-487d-be41-b00c7e6848f3 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:20.806416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0abc22-d012-4844-a43f-a9140b324a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:20.807544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0abc22-d012-4844-a43f-a9140b324a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:20.807544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0abc22-d012-4844-a43f-a9140b324a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:20.808045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0abc22-d012-4844-a43f-a9140b324a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:20.808802 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0abc22-d012-4844-a43f-a9140b324a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:20.810582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0abc22-d012-4844-a43f-a9140b324a5c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:20.823924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1205/2415] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:20.827860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc73dd-59a4-4f05-8f0c-0b084040e596 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:20.842043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7947e-2ae8-467c-b9f9-09a9474f8264 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:20.842321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7947e-2ae8-467c-b9f9-09a9474f8264 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:20.842592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7947e-2ae8-467c-b9f9-09a9474f8264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:20.845343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc73dd-59a4-4f05-8f0c-0b084040e596 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:20.851673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98694062-3d0f-4449-9eba-33c14370924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:20.852664 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694062-3d0f-4449-9eba-33c14370924a admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:20.853102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694062-3d0f-4449-9eba-33c14370924a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:20.853568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694062-3d0f-4449-9eba-33c14370924a admin admin] PATH_INFO: `/v3/projects/5fe1c14fcf3447d0b97fa1fc811f5138/users/394b4524a7354b9695f0f80cfc85f3c6/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:20.876475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e4d7947e-2ae8-467c-b9f9-09a9474f8264 None None] MFA Rules not processed for user `6ff415d9fc54474180bb143881a5da02`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:20.880054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e4d7947e-2ae8-467c-b9f9-09a9474f8264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:20.904635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98694062-3d0f-4449-9eba-33c14370924a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe1c14fcf3447d0b97fa1fc811f5138, user_id=394b4524a7354b9695f0f80cfc85f3c6, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:20.955514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98694062-3d0f-4449-9eba-33c14370924a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:20.982967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1206/2416] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:33:21.067358 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1211/2417] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:20 2022] PUT /identity/v3/projects/5fe1c14fcf3447d0b97fa1fc811f5138/users/394b4524a7354b9695f0f80cfc85f3c6/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:21.072765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7947e-2ae8-467c-b9f9-09a9474f8264 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:21.089265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7947e-2ae8-467c-b9f9-09a9474f8264 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:21.171553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a1d1c-3143-4023-882f-b50c21415d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:21.172343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a1d1c-3143-4023-882f-b50c21415d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:21.172865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a1d1c-3143-4023-882f-b50c21415d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:21.173480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a1d1c-3143-4023-882f-b50c21415d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:21.174414 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a1d1c-3143-4023-882f-b50c21415d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:21.176370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a1d1c-3143-4023-882f-b50c21415d8e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:21.187473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1207/2418] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:21.192445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98694062-3d0f-4449-9eba-33c14370924a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:21.204502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98694062-3d0f-4449-9eba-33c14370924a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:21.210529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1c3b-b143-4465-88e4-c3fd859d16d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:21.211511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1c3b-b143-4465-88e4-c3fd859d16d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:21.211962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1c3b-b143-4465-88e4-c3fd859d16d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:21.212319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1c3b-b143-4465-88e4-c3fd859d16d4 admin admin] PATH_INFO: `/v3/projects/5fe1c14fcf3447d0b97fa1fc811f5138/users/394b4524a7354b9695f0f80cfc85f3c6/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:21.214543 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b1c3b-b143-4465-88e4-c3fd859d16d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe1c14fcf3447d0b97fa1fc811f5138, user_id=394b4524a7354b9695f0f80cfc85f3c6, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:21.217706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b1c3b-b143-4465-88e4-c3fd859d16d4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:21.230929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1212/2419] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:21 2022] PUT /identity/v3/projects/5fe1c14fcf3447d0b97fa1fc811f5138/users/394b4524a7354b9695f0f80cfc85f3c6/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:21.243282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89e5c-9b83-4a3d-b86a-5dbbb360d79d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:21.243568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89e5c-9b83-4a3d-b86a-5dbbb360d79d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:21.243843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89e5c-9b83-4a3d-b86a-5dbbb360d79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:21.286448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1ed89e5c-9b83-4a3d-b86a-5dbbb360d79d None None] MFA Rules not processed for user `394b4524a7354b9695f0f80cfc85f3c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:21.288086 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1ed89e5c-9b83-4a3d-b86a-5dbbb360d79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:21.405654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1208/2420] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:21.425082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1c3b-b143-4465-88e4-c3fd859d16d4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:21.431494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0d9b1c3b-b143-4465-88e4-c3fd859d16d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:21.441877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89e5c-9b83-4a3d-b86a-5dbbb360d79d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:21.443683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1ed89e5c-9b83-4a3d-b86a-5dbbb360d79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:21.528515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1c3b-b143-4465-88e4-c3fd859d16d4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:21.536210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac600f53-1701-48b1-8afb-bb5b5cd0bf19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:21.536909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac600f53-1701-48b1-8afb-bb5b5cd0bf19 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:21.538106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac600f53-1701-48b1-8afb-bb5b5cd0bf19 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:21.538409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac600f53-1701-48b1-8afb-bb5b5cd0bf19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:21.540507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ac600f53-1701-48b1-8afb-bb5b5cd0bf19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:21.555441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89e5c-9b83-4a3d-b86a-5dbbb360d79d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:21.560071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3a241-62ca-48ee-afa4-67c7d4a4b338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:21.561027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3a241-62ca-48ee-afa4-67c7d4a4b338 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:21.561027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3a241-62ca-48ee-afa4-67c7d4a4b338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:21.561283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3a241-62ca-48ee-afa4-67c7d4a4b338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:21.574014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3a241-62ca-48ee-afa4-67c7d4a4b338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:21.575255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3a241-62ca-48ee-afa4-67c7d4a4b338 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:21.586947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1209/2421] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:21.656564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac600f53-1701-48b1-8afb-bb5b5cd0bf19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:21.666901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac600f53-1701-48b1-8afb-bb5b5cd0bf19 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:21.672393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3a241-62ca-48ee-afa4-67c7d4a4b338 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:21.676439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2be3a241-62ca-48ee-afa4-67c7d4a4b338 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:21.680979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1213/2422] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:21.696587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3a241-62ca-48ee-afa4-67c7d4a4b338 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:21.702327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8c8de-be76-469a-b427-625a1f49e8ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:21.703275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8c8de-be76-469a-b427-625a1f49e8ba service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:21.705145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:21.711322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8c8de-be76-469a-b427-625a1f49e8ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:21.711322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8c8de-be76-469a-b427-625a1f49e8ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:21.838922 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8c8de-be76-469a-b427-625a1f49e8ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:21.840416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8c8de-be76-469a-b427-625a1f49e8ba service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:21.856407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1210/2423] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:33:22.285854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:22.695179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac600f53-1701-48b1-8afb-bb5b5cd0bf19 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:22.698065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ac600f53-1701-48b1-8afb-bb5b5cd0bf19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:22.791448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac600f53-1701-48b1-8afb-bb5b5cd0bf19 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:22.803496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:22.804408 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:22.804717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:22.805009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] PATH_INFO: `/v3/users/0d3f8698de174d9d9839681a23441cb2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:22.806174 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3f8698de174d9d9839681a23441cb2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:22.810968 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:23.019129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3f8698de174d9d9839681a23441cb2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:23.108006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3f8698de174d9d9839681a23441cb2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:23.117234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3f8698de174d9d9839681a23441cb2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:23.118525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3f8698de174d9d9839681a23441cb2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:23.131836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3f8698de174d9d9839681a23441cb2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:23.144734 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1214/2424] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:22 2022] DELETE /identity/v3/users/0d3f8698de174d9d9839681a23441cb2 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:23.146926 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a0059-cffe-403a-aa3e-ce45b4905247 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:23.147410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a0059-cffe-403a-aa3e-ce45b4905247 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:23.147490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a0059-cffe-403a-aa3e-ce45b4905247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:23.173188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4d3a0059-cffe-403a-aa3e-ce45b4905247 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:23.174736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4d3a0059-cffe-403a-aa3e-ce45b4905247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:23.264155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1211/2425] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:33:23.282805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:23.284875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:23.345232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ce760-a84f-4983-ba29-0defbacf8020 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:23.349494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccbd60-7eb6-457b-a38a-cd96cfa5c20d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:23.350157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccbd60-7eb6-457b-a38a-cd96cfa5c20d service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:23.350430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccbd60-7eb6-457b-a38a-cd96cfa5c20d service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:23.350697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccbd60-7eb6-457b-a38a-cd96cfa5c20d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:23.360288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccbd60-7eb6-457b-a38a-cd96cfa5c20d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:23.361726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccbd60-7eb6-457b-a38a-cd96cfa5c20d service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:23.372228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1215/2426] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:24.102557 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:24.166978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a0059-cffe-403a-aa3e-ce45b4905247 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:24.168888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4d3a0059-cffe-403a-aa3e-ce45b4905247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:24.181929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a0059-cffe-403a-aa3e-ce45b4905247 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:24.187309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:24.188226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:24.191440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:24.191440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] PATH_INFO: `/v3/projects/a81f6d8800534947a1810d9675d88bb3` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:24.191440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81f6d8800534947a1810d9675d88bb3)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:24.203817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:24.354833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81f6d8800534947a1810d9675d88bb3', 'request_id': 'req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:24.363204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81f6d8800534947a1810d9675d88bb3', 'request_id': 'req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:24.379756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81f6d8800534947a1810d9675d88bb3', 'request_id': 'req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:24.450546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] The token cache is being invalidate because project a81f6d8800534947a1810d9675d88bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:24.451255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:24.453033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-692811e4-ac3a-4a8a-80aa-9b3ce83a1dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:24.455339 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1212/2427] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:24 2022] DELETE /identity/v3/projects/a81f6d8800534947a1810d9675d88bb3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:24.462892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c571-0716-43c8-8254-d8060885b3fd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:24.463373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c571-0716-43c8-8254-d8060885b3fd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:24.463463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c571-0716-43c8-8254-d8060885b3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:24.501283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9d98c571-0716-43c8-8254-d8060885b3fd None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:24.502670 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9d98c571-0716-43c8-8254-d8060885b3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:24.581350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1216/2428] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:24.588858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192216-f134-44a9-878a-9a10b8893c3b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:24.589147 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192216-f134-44a9-878a-9a10b8893c3b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:24.589425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192216-f134-44a9-878a-9a10b8893c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:24.611196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-fe192216-f134-44a9-878a-9a10b8893c3b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:24.612976 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fe192216-f134-44a9-878a-9a10b8893c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:24.625285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1213/2429] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:24.629474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98c571-0716-43c8-8254-d8060885b3fd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:24.639771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98c571-0716-43c8-8254-d8060885b3fd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:24.649264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec870d45-f416-447f-8ced-e660b6f0297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:24.649895 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec870d45-f416-447f-8ced-e660b6f0297f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:24.650225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec870d45-f416-447f-8ced-e660b6f0297f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:24.650674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec870d45-f416-447f-8ced-e660b6f0297f admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:24.651330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec870d45-f416-447f-8ced-e660b6f0297f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:24.651637 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec870d45-f416-447f-8ced-e660b6f0297f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:24.653308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec870d45-f416-447f-8ced-e660b6f0297f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:24.669747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1217/2430] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:33:24.670866 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe192216-f134-44a9-878a-9a10b8893c3b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:24.681068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe192216-f134-44a9-878a-9a10b8893c3b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:24.686186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092ca2a-c2a2-4765-898e-801f1efb94a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:24.687349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ca2a-c2a2-4765-898e-801f1efb94a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:24.687349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ca2a-c2a2-4765-898e-801f1efb94a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:24.687349 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ca2a-c2a2-4765-898e-801f1efb94a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:24.688077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092ca2a-c2a2-4765-898e-801f1efb94a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:24.690109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092ca2a-c2a2-4765-898e-801f1efb94a6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:24.709066 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:24.779789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1214/2431] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:24 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:24.801643 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec870d45-f416-447f-8ced-e660b6f0297f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:24.843173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec870d45-f416-447f-8ced-e660b6f0297f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:24.969224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dbfa7-171c-4c9b-a791-a8ae6dd79865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:24.969960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dbfa7-171c-4c9b-a791-a8ae6dd79865 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:24.970246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dbfa7-171c-4c9b-a791-a8ae6dd79865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:24.970516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dbfa7-171c-4c9b-a791-a8ae6dd79865 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:24.971249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dbfa7-171c-4c9b-a791-a8ae6dd79865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:24.973469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dbfa7-171c-4c9b-a791-a8ae6dd79865 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:25.061143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40b0d-fe69-4b24-9367-d3800d922eb4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:25.061432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40b0d-fe69-4b24-9367-d3800d922eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:25.061708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40b0d-fe69-4b24-9367-d3800d922eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:25.065226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1218/2432] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:24 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:25.072259 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dbfa7-171c-4c9b-a791-a8ae6dd79865 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:25.102373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dbfa7-171c-4c9b-a791-a8ae6dd79865 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:25.109445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-eda40b0d-fe69-4b24-9367-d3800d922eb4 None None] MFA Rules not processed for user `4d6e2fea3aeb479685e6f9dbaf6b5dea`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:25.110768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-eda40b0d-fe69-4b24-9367-d3800d922eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:25.119715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be100d-a065-493f-be2a-7f122698f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:25.120377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be100d-a065-493f-be2a-7f122698f12c admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:25.120659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be100d-a065-493f-be2a-7f122698f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:25.120937 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be100d-a065-493f-be2a-7f122698f12c admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:25.121674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be100d-a065-493f-be2a-7f122698f12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:25.123248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be100d-a065-493f-be2a-7f122698f12c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:25.147234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1219/2433] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:25.150897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be100d-a065-493f-be2a-7f122698f12c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:25.169997 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be100d-a065-493f-be2a-7f122698f12c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:25.175666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00582007-607d-4569-a01c-ad699f6cd9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:25.177010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00582007-607d-4569-a01c-ad699f6cd9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:25.177302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00582007-607d-4569-a01c-ad699f6cd9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:25.177578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00582007-607d-4569-a01c-ad699f6cd9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:25.178389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00582007-607d-4569-a01c-ad699f6cd9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:25.180055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00582007-607d-4569-a01c-ad699f6cd9c6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:25.197966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1220/2434] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:25.199537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00582007-607d-4569-a01c-ad699f6cd9c6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:25.215510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00582007-607d-4569-a01c-ad699f6cd9c6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:25.216459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1215/2435] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:25.221853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011d32-dc7f-440e-9668-748089237abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:25.222614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011d32-dc7f-440e-9668-748089237abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:25.223730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011d32-dc7f-440e-9668-748089237abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:25.229773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011d32-dc7f-440e-9668-748089237abb admin admin] PATH_INFO: `/v3/projects/219868ca971446758f29feaf14568afd/users/63b69198ca614c4eb0b6b400499c1ab1/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:25.255795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71011d32-dc7f-440e-9668-748089237abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=219868ca971446758f29feaf14568afd, user_id=63b69198ca614c4eb0b6b400499c1ab1, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:25.258847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71011d32-dc7f-440e-9668-748089237abb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:25.354498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1221/2436] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:25 2022] PUT /identity/v3/projects/219868ca971446758f29feaf14568afd/users/63b69198ca614c4eb0b6b400499c1ab1/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:25.364216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df616-6da7-4d9f-8c0b-b89098415b00 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:25.364774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df616-6da7-4d9f-8c0b-b89098415b00 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:25.365079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df616-6da7-4d9f-8c0b-b89098415b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:25.399414 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-371df616-6da7-4d9f-8c0b-b89098415b00 None None] MFA Rules not processed for user `63b69198ca614c4eb0b6b400499c1ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:25.400722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-371df616-6da7-4d9f-8c0b-b89098415b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:25.487968 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1216/2437] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:25.523588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:25.562515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011d32-dc7f-440e-9668-748089237abb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:25.564236 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-71011d32-dc7f-440e-9668-748089237abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:25.640199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011d32-dc7f-440e-9668-748089237abb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:25.647748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4640c-3349-493f-881c-1713efa54632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:25.648409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4640c-3349-493f-881c-1713efa54632 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:25.648688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4640c-3349-493f-881c-1713efa54632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:25.648958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4640c-3349-493f-881c-1713efa54632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:25.658628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4640c-3349-493f-881c-1713efa54632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:25.660320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4640c-3349-493f-881c-1713efa54632 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:25.678278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1222/2438] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:26.318235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:27.016678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:27.478114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:27.733653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:28.296728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26c03-0012-4736-9977-811a5e9b14da None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:28.297635 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26c03-0012-4736-9977-811a5e9b14da None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:28.297922 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26c03-0012-4736-9977-811a5e9b14da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:28.319877 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a8f26c03-0012-4736-9977-811a5e9b14da None None] MFA Rules not processed for user `63b69198ca614c4eb0b6b400499c1ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:28.321125 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a8f26c03-0012-4736-9977-811a5e9b14da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:28.328010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1217/2439] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:28.331195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:28.405115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:28.684117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:28.982407 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4640c-3349-493f-881c-1713efa54632 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:28.982407 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4bd4640c-3349-493f-881c-1713efa54632 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:29.060212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:29.064284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4640c-3349-493f-881c-1713efa54632 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:29.069713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:29.070179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:29.070459 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:29.070728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] PATH_INFO: `/v3/users/3b362759691b418289832e444e597d79` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:29.071855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b362759691b418289832e444e597d79)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:29.073799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:29.094718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:29.199312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:29.274401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b362759691b418289832e444e597d79'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:29.376576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b362759691b418289832e444e597d79'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:29.387059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b362759691b418289832e444e597d79'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:29.388940 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:29.389990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b362759691b418289832e444e597d79'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:29.423365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b362759691b418289832e444e597d79'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:29.431188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1223/2440] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:28 2022] DELETE /identity/v3/users/3b362759691b418289832e444e597d79 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:33:29.435735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2f32-e7c0-43bf-a21a-04995cb56468 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:29.436209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2f32-e7c0-43bf-a21a-04995cb56468 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:29.436348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2f32-e7c0-43bf-a21a-04995cb56468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:29.455187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-87ec2f32-e7c0-43bf-a21a-04995cb56468 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:29.456413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-87ec2f32-e7c0-43bf-a21a-04995cb56468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:29.530898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1218/2441] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:29.541343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:29.543700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:29.603710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab7274-f770-4fe1-b2ad-fb0790e1e36d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:29.607676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eba68-af62-4af9-91b1-b30809faafc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:29.608420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eba68-af62-4af9-91b1-b30809faafc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:29.608699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eba68-af62-4af9-91b1-b30809faafc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:29.608984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eba68-af62-4af9-91b1-b30809faafc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:29.618786 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88eba68-af62-4af9-91b1-b30809faafc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:29.620288 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88eba68-af62-4af9-91b1-b30809faafc9 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:29.630486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1224/2442] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:29.683906 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:29.911686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:30.136379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec2f32-e7c0-43bf-a21a-04995cb56468 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:30.141300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-87ec2f32-e7c0-43bf-a21a-04995cb56468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:30.166756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec2f32-e7c0-43bf-a21a-04995cb56468 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:30.176270 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:30.178315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:30.178911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:30.179768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] PATH_INFO: `/v3/projects/3eeb3e70d93641839025f76e86ffb891` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:30.181827 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eeb3e70d93641839025f76e86ffb891)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:30.184344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:30.313939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eeb3e70d93641839025f76e86ffb891', 'request_id': 'req-7330800f-15ab-46e9-b472-803bb9cfe81c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:30.320927 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eeb3e70d93641839025f76e86ffb891', 'request_id': 'req-7330800f-15ab-46e9-b472-803bb9cfe81c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:30.329267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eeb3e70d93641839025f76e86ffb891', 'request_id': 'req-7330800f-15ab-46e9-b472-803bb9cfe81c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:30.371442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:30.403532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] The token cache is being invalidate because project 3eeb3e70d93641839025f76e86ffb891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:30.403860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:30.404539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:30.406099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1219/2443] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:30 2022] DELETE /identity/v3/projects/3eeb3e70d93641839025f76e86ffb891 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:30.408931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:30.413796 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eba68-af62-4af9-91b1-b30809faafc9 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:30.423972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eba68-af62-4af9-91b1-b30809faafc9 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:30.489544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:30.490264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:30.490994 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:30.491259 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] PATH_INFO: `/v3/users/394b4524a7354b9695f0f80cfc85f3c6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:30.492386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=394b4524a7354b9695f0f80cfc85f3c6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:30.494576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:30.794371 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394b4524a7354b9695f0f80cfc85f3c6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:30.880004 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394b4524a7354b9695f0f80cfc85f3c6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:30.888313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394b4524a7354b9695f0f80cfc85f3c6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:30.889850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394b4524a7354b9695f0f80cfc85f3c6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:30.902163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8d53e946-aac0-44b5-ad12-54dde1c73fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394b4524a7354b9695f0f80cfc85f3c6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:30.908023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1225/2444] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:30 2022] DELETE /identity/v3/users/394b4524a7354b9695f0f80cfc85f3c6 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:31.417712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:31.497815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:31.757957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:31.759652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:31.779480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330800f-15ab-46e9-b472-803bb9cfe81c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:31.843371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:31.844052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:31.844331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:31.844601 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] PATH_INFO: `/v3/projects/5fe1c14fcf3447d0b97fa1fc811f5138` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:31.845795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe1c14fcf3447d0b97fa1fc811f5138)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:31.847716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:31.964034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe1c14fcf3447d0b97fa1fc811f5138', 'request_id': 'req-7aad0443-07c5-4c0f-9254-dc81381cd5f5'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:31.970126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe1c14fcf3447d0b97fa1fc811f5138', 'request_id': 'req-7aad0443-07c5-4c0f-9254-dc81381cd5f5'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:31.976670 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe1c14fcf3447d0b97fa1fc811f5138', 'request_id': 'req-7aad0443-07c5-4c0f-9254-dc81381cd5f5'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:32.084501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] The token cache is being invalidate because project 5fe1c14fcf3447d0b97fa1fc811f5138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:32.085728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:32.086525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7aad0443-07c5-4c0f-9254-dc81381cd5f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:32.088684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1220/2445] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:31 2022] DELETE /identity/v3/projects/5fe1c14fcf3447d0b97fa1fc811f5138 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:32.099159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b8631-89d9-44b6-8ca5-6cde8fc5570e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:32.099441 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b8631-89d9-44b6-8ca5-6cde8fc5570e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:32.099716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b8631-89d9-44b6-8ca5-6cde8fc5570e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:32.121868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-911b8631-89d9-44b6-8ca5-6cde8fc5570e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:32.127528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-911b8631-89d9-44b6-8ca5-6cde8fc5570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:32.197965 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1226/2446] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:33:32.206142 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7ebff-f181-44f8-ac68-e15b209b5390 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:32.206710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7ebff-f181-44f8-ac68-e15b209b5390 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:32.207195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7ebff-f181-44f8-ac68-e15b209b5390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:32.229766 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f9f7ebff-f181-44f8-ac68-e15b209b5390 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:32.231250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f9f7ebff-f181-44f8-ac68-e15b209b5390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:32.239970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1221/2447] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:33:32.245447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b8631-89d9-44b6-8ca5-6cde8fc5570e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:32.259829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b8631-89d9-44b6-8ca5-6cde8fc5570e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:32.268482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9e3d2-e5da-475f-a95c-2bd7babd3bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:32.269153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e3d2-e5da-475f-a95c-2bd7babd3bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:32.269437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e3d2-e5da-475f-a95c-2bd7babd3bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:32.269702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e3d2-e5da-475f-a95c-2bd7babd3bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:32.270367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9e3d2-e5da-475f-a95c-2bd7babd3bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:32.270672 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9e3d2-e5da-475f-a95c-2bd7babd3bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:32.274648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9e3d2-e5da-475f-a95c-2bd7babd3bd9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:32.287427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1227/2448] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:33:32.292025 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7ebff-f181-44f8-ac68-e15b209b5390 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:32.307388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7ebff-f181-44f8-ac68-e15b209b5390 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:32.312509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57357882-136b-4441-a38c-0ef5af0014cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:32.313126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57357882-136b-4441-a38c-0ef5af0014cf admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:32.313407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57357882-136b-4441-a38c-0ef5af0014cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:32.314246 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57357882-136b-4441-a38c-0ef5af0014cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:32.314907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57357882-136b-4441-a38c-0ef5af0014cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:32.316888 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57357882-136b-4441-a38c-0ef5af0014cf admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:32.392348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:32.406618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1222/2449] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:32 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:33:32.408395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9e3d2-e5da-475f-a95c-2bd7babd3bd9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:32.433460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9e3d2-e5da-475f-a95c-2bd7babd3bd9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:32.649095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6efd07-087e-482f-967c-37fa49f4c8bc None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:32.649635 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6efd07-087e-482f-967c-37fa49f4c8bc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:32.649928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6efd07-087e-482f-967c-37fa49f4c8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:32.660930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:32.671207 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3d6efd07-087e-482f-967c-37fa49f4c8bc None None] MFA Rules not processed for user `8bd18df842724159869f630f96229758`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:32.672584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3d6efd07-087e-482f-967c-37fa49f4c8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:32.693766 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261360ac-7be7-42c7-89dd-c6e2d7837060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:32.694821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261360ac-7be7-42c7-89dd-c6e2d7837060 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:32.695343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261360ac-7be7-42c7-89dd-c6e2d7837060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:32.695460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261360ac-7be7-42c7-89dd-c6e2d7837060 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:32.696227 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261360ac-7be7-42c7-89dd-c6e2d7837060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:32.698499 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261360ac-7be7-42c7-89dd-c6e2d7837060 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:32.736379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1223/2450] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:32.845853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1228/2451] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:32 2022] POST /identity/v3/users => generated 295 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:32.850176 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6efd07-087e-482f-967c-37fa49f4c8bc None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:32.861279 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6efd07-087e-482f-967c-37fa49f4c8bc None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:32.865891 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38070159-1880-4013-8539-a27830a881c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:32.866498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38070159-1880-4013-8539-a27830a881c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:32.866772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38070159-1880-4013-8539-a27830a881c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:32.867041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38070159-1880-4013-8539-a27830a881c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:32.867685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38070159-1880-4013-8539-a27830a881c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:32.869621 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38070159-1880-4013-8539-a27830a881c2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:32.880624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1224/2452] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:32.885204 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261360ac-7be7-42c7-89dd-c6e2d7837060 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:32.895797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261360ac-7be7-42c7-89dd-c6e2d7837060 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:32.901164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae62749-f497-4d52-9ca0-169843d82174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:32.901958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae62749-f497-4d52-9ca0-169843d82174 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:32.902351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae62749-f497-4d52-9ca0-169843d82174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:32.902624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae62749-f497-4d52-9ca0-169843d82174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:32.903366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae62749-f497-4d52-9ca0-169843d82174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:32.905359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae62749-f497-4d52-9ca0-169843d82174 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:32.919948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1229/2453] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:32.921367 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38070159-1880-4013-8539-a27830a881c2 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:32.932492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38070159-1880-4013-8539-a27830a881c2 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:32.938324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c78d48-9bec-4ffd-9470-d93331d3f912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:32.938996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c78d48-9bec-4ffd-9470-d93331d3f912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:32.939274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c78d48-9bec-4ffd-9470-d93331d3f912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:32.939545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c78d48-9bec-4ffd-9470-d93331d3f912 admin admin] PATH_INFO: `/v3/projects/1a5c175cf59d45c2b3c77825415c24fb/users/7bb1d608f8724823a7c2f62f928d4c25/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:32.962951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c78d48-9bec-4ffd-9470-d93331d3f912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a5c175cf59d45c2b3c77825415c24fb, user_id=7bb1d608f8724823a7c2f62f928d4c25, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:32.968629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c78d48-9bec-4ffd-9470-d93331d3f912 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:33.035720 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1225/2454] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:32 2022] PUT /identity/v3/projects/1a5c175cf59d45c2b3c77825415c24fb/users/7bb1d608f8724823a7c2f62f928d4c25/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:33.046659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67776f9d-f0d5-4eb4-b9fd-3b66c9a43076 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:33.046941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67776f9d-f0d5-4eb4-b9fd-3b66c9a43076 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:33.047209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67776f9d-f0d5-4eb4-b9fd-3b66c9a43076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:33.077116 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-67776f9d-f0d5-4eb4-b9fd-3b66c9a43076 None None] MFA Rules not processed for user `7bb1d608f8724823a7c2f62f928d4c25`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:33.078735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-67776f9d-f0d5-4eb4-b9fd-3b66c9a43076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:33.150064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:33.150064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1230/2455] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:33.151258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c78d48-9bec-4ffd-9470-d93331d3f912 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:33.172318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:33.218016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c78d48-9bec-4ffd-9470-d93331d3f912 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:33.223138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6386c-638d-41f6-a655-35257ad5e254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:33.223739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6386c-638d-41f6-a655-35257ad5e254 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:33.224148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6386c-638d-41f6-a655-35257ad5e254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:33.224419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6386c-638d-41f6-a655-35257ad5e254 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:33.225217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6386c-638d-41f6-a655-35257ad5e254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:33.227281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6386c-638d-41f6-a655-35257ad5e254 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:33.316208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1226/2456] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:33 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:33.321478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67776f9d-f0d5-4eb4-b9fd-3b66c9a43076 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:33.333537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67776f9d-f0d5-4eb4-b9fd-3b66c9a43076 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:33.400906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc7e69-fea3-4f3e-a470-c408b570f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:33.401534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc7e69-fea3-4f3e-a470-c408b570f9bc admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:33.401808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc7e69-fea3-4f3e-a470-c408b570f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:33.402104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc7e69-fea3-4f3e-a470-c408b570f9bc admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:33.402941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc7e69-fea3-4f3e-a470-c408b570f9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:33.405072 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc7e69-fea3-4f3e-a470-c408b570f9bc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:33.531392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1231/2457] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:33 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:33.535152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6386c-638d-41f6-a655-35257ad5e254 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:33.552918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6386c-638d-41f6-a655-35257ad5e254 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:33.586337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa6fe-389e-4afc-9183-9438f0a8fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:33.586337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa6fe-389e-4afc-9183-9438f0a8fa4f admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:33.586337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa6fe-389e-4afc-9183-9438f0a8fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:33.586337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa6fe-389e-4afc-9183-9438f0a8fa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:33.589298 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:33.590072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fa6fe-389e-4afc-9183-9438f0a8fa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:33.592135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fa6fe-389e-4afc-9183-9438f0a8fa4f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:33.607395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1227/2458] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:33.608809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc7e69-fea3-4f3e-a470-c408b570f9bc admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:33.616938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:33.647708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc7e69-fea3-4f3e-a470-c408b570f9bc admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:33.666321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161163d-a094-41fe-9f4a-5c0a3bb43bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:33.667018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161163d-a094-41fe-9f4a-5c0a3bb43bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:33.667298 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161163d-a094-41fe-9f4a-5c0a3bb43bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:33.667568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161163d-a094-41fe-9f4a-5c0a3bb43bb0 admin admin] PATH_INFO: `/v3/projects/f157347f5a1641ad875fec636c3748d5/users/6d55ecbeee7f4db099bd734891a9f0a9/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:33.702065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161163d-a094-41fe-9f4a-5c0a3bb43bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f157347f5a1641ad875fec636c3748d5, user_id=6d55ecbeee7f4db099bd734891a9f0a9, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:33.704657 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161163d-a094-41fe-9f4a-5c0a3bb43bb0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:33.793194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1232/2459] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:33 2022] PUT /identity/v3/projects/f157347f5a1641ad875fec636c3748d5/users/6d55ecbeee7f4db099bd734891a9f0a9/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:33.797548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa6fe-389e-4afc-9183-9438f0a8fa4f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:33.810097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa6fe-389e-4afc-9183-9438f0a8fa4f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:33.901554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1faa-a2b9-432c-8d94-50343ed62454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:33.903397 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1faa-a2b9-432c-8d94-50343ed62454 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:33.904034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1faa-a2b9-432c-8d94-50343ed62454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:33.904034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1faa-a2b9-432c-8d94-50343ed62454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:33.904704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def1faa-a2b9-432c-8d94-50343ed62454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:33.906325 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def1faa-a2b9-432c-8d94-50343ed62454 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:33.919928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1228/2460] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:33.922027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161163d-a094-41fe-9f4a-5c0a3bb43bb0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:33.932900 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161163d-a094-41fe-9f4a-5c0a3bb43bb0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:33.938349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84bbcb-ad21-4c06-8ce6-680d6d205ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:33.939044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84bbcb-ad21-4c06-8ce6-680d6d205ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:33.939324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84bbcb-ad21-4c06-8ce6-680d6d205ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:33.939599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84bbcb-ad21-4c06-8ce6-680d6d205ff2 admin admin] PATH_INFO: `/v3/projects/f157347f5a1641ad875fec636c3748d5/users/6d55ecbeee7f4db099bd734891a9f0a9/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:33.941818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84bbcb-ad21-4c06-8ce6-680d6d205ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f157347f5a1641ad875fec636c3748d5, user_id=6d55ecbeee7f4db099bd734891a9f0a9, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:33.944772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84bbcb-ad21-4c06-8ce6-680d6d205ff2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:33.956749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1233/2461] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:33 2022] PUT /identity/v3/projects/f157347f5a1641ad875fec636c3748d5/users/6d55ecbeee7f4db099bd734891a9f0a9/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:33.968536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90eb42-0809-4b08-bc41-3d439fe5c122 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:33.968828 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90eb42-0809-4b08-bc41-3d439fe5c122 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:33.969307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90eb42-0809-4b08-bc41-3d439fe5c122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:34.005166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-eb90eb42-0809-4b08-bc41-3d439fe5c122 None None] MFA Rules not processed for user `6d55ecbeee7f4db099bd734891a9f0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:34.006755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-eb90eb42-0809-4b08-bc41-3d439fe5c122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:34.040041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:34.063052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:34.092068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1229/2462] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:34.099821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84bbcb-ad21-4c06-8ce6-680d6d205ff2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:34.102219 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6b84bbcb-ad21-4c06-8ce6-680d6d205ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:34.162415 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84bbcb-ad21-4c06-8ce6-680d6d205ff2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:34.166155 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7f754-0dd8-4db4-a687-eae019cf29e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:34.166772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7f754-0dd8-4db4-a687-eae019cf29e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:34.167383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7f754-0dd8-4db4-a687-eae019cf29e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:34.167383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7f754-0dd8-4db4-a687-eae019cf29e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:34.176604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7f754-0dd8-4db4-a687-eae019cf29e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:34.178029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7f754-0dd8-4db4-a687-eae019cf29e4 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:34.188195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1234/2463] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:34.339370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90eb42-0809-4b08-bc41-3d439fe5c122 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:34.418835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90eb42-0809-4b08-bc41-3d439fe5c122 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:34.423465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:34.424224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:34.424500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:34.424776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] PATH_INFO: `/v3/users/7bb1d608f8724823a7c2f62f928d4c25` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:34.425896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb1d608f8724823a7c2f62f928d4c25)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:34.427823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:34.653120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb1d608f8724823a7c2f62f928d4c25'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:34.653895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb1d608f8724823a7c2f62f928d4c25'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:34.668311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb1d608f8724823a7c2f62f928d4c25'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:34.677972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb1d608f8724823a7c2f62f928d4c25'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:34.696831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:34.753293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb1d608f8724823a7c2f62f928d4c25'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:34.761194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1230/2464] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:34 2022] DELETE /identity/v3/users/7bb1d608f8724823a7c2f62f928d4c25 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:34.765444 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ff8cf-688b-473b-bfff-d15fd1872b1b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:34.765774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ff8cf-688b-473b-bfff-d15fd1872b1b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:34.766057 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ff8cf-688b-473b-bfff-d15fd1872b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:34.772072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:34.790371 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8c1ff8cf-688b-473b-bfff-d15fd1872b1b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:34.791654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8c1ff8cf-688b-473b-bfff-d15fd1872b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:34.872831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1235/2465] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:34.889729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:34.891324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:34.940312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:34.973648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:34.973876 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616a929-7c7d-444e-8a58-e5c3c06f16ae admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:34.978785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90face46-5d64-4507-9d0f-c30aeeac5f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:34.979523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90face46-5d64-4507-9d0f-c30aeeac5f9e service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:34.979861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90face46-5d64-4507-9d0f-c30aeeac5f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:34.983631 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90face46-5d64-4507-9d0f-c30aeeac5f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:34.990299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90face46-5d64-4507-9d0f-c30aeeac5f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:34.992634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90face46-5d64-4507-9d0f-c30aeeac5f9e service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:35.005016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:35.015501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1231/2466] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:35.184724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:35.237894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:35.596355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ff8cf-688b-473b-bfff-d15fd1872b1b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:35.598227 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8c1ff8cf-688b-473b-bfff-d15fd1872b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:35.613388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ff8cf-688b-473b-bfff-d15fd1872b1b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:35.620984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:35.621660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:35.622029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:35.622197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] PATH_INFO: `/v3/projects/1a5c175cf59d45c2b3c77825415c24fb` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:35.623828 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a5c175cf59d45c2b3c77825415c24fb)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:35.625732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:35.632607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:35.748943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a5c175cf59d45c2b3c77825415c24fb', 'request_id': 'req-47a5349a-1ff4-44da-b60e-04e83590a372'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:35.754794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a5c175cf59d45c2b3c77825415c24fb', 'request_id': 'req-47a5349a-1ff4-44da-b60e-04e83590a372'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:35.764545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a5c175cf59d45c2b3c77825415c24fb', 'request_id': 'req-47a5349a-1ff4-44da-b60e-04e83590a372'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:35.805126 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:35.838852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] The token cache is being invalidate because project 1a5c175cf59d45c2b3c77825415c24fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:35.838852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:35.839522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:35.841114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1236/2467] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:35 2022] DELETE /identity/v3/projects/1a5c175cf59d45c2b3c77825415c24fb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:35.845331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90face46-5d64-4507-9d0f-c30aeeac5f9e service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:35.855972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90face46-5d64-4507-9d0f-c30aeeac5f9e service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:35.918913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:35.919599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:35.919731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:35.920039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] PATH_INFO: `/v3/users/6d55ecbeee7f4db099bd734891a9f0a9` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:35.921193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d55ecbeee7f4db099bd734891a9f0a9)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:35.923155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:36.114095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d55ecbeee7f4db099bd734891a9f0a9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:36.114836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d55ecbeee7f4db099bd734891a9f0a9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:36.129225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d55ecbeee7f4db099bd734891a9f0a9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:36.136482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d55ecbeee7f4db099bd734891a9f0a9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:36.208190 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-889f5135-95b5-41ea-ab8a-8b7d6e8a5280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d55ecbeee7f4db099bd734891a9f0a9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:36.215201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1232/2468] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:35 2022] DELETE /identity/v3/users/6d55ecbeee7f4db099bd734891a9f0a9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:36.345738 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:36.525596 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:36.703599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:36.705335 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:36.728231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5349a-1ff4-44da-b60e-04e83590a372 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:36.801956 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:36.841138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:36.841138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:36.841138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] PATH_INFO: `/v3/projects/f157347f5a1641ad875fec636c3748d5` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:36.841138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f157347f5a1641ad875fec636c3748d5)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:36.841138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:36.902985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:36.974072 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f157347f5a1641ad875fec636c3748d5', 'request_id': 'req-a693c792-2cf3-427b-bc72-f07e5626f2c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:36.980741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f157347f5a1641ad875fec636c3748d5', 'request_id': 'req-a693c792-2cf3-427b-bc72-f07e5626f2c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:36.987252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f157347f5a1641ad875fec636c3748d5', 'request_id': 'req-a693c792-2cf3-427b-bc72-f07e5626f2c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:37.067689 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] The token cache is being invalidate because project f157347f5a1641ad875fec636c3748d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:37.068090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:37.068771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a693c792-2cf3-427b-bc72-f07e5626f2c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:37.070347 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1237/2469] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:36 2022] DELETE /identity/v3/projects/f157347f5a1641ad875fec636c3748d5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:37.075730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7983bf8-54b3-4e04-b7f0-d7d59941307c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:37.076364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7983bf8-54b3-4e04-b7f0-d7d59941307c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:37.076364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7983bf8-54b3-4e04-b7f0-d7d59941307c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:37.082163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:37.097211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c7983bf8-54b3-4e04-b7f0-d7d59941307c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:37.098432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c7983bf8-54b3-4e04-b7f0-d7d59941307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:37.170820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1233/2470] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:37.180133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53f7d-95a3-4e5d-acc4-ae6aafe3ea73 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:37.180454 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53f7d-95a3-4e5d-acc4-ae6aafe3ea73 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:37.180839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53f7d-95a3-4e5d-acc4-ae6aafe3ea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:37.215453 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-21a53f7d-95a3-4e5d-acc4-ae6aafe3ea73 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:37.217065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-21a53f7d-95a3-4e5d-acc4-ae6aafe3ea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:37.227678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1238/2471] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:37.233644 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7983bf8-54b3-4e04-b7f0-d7d59941307c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:37.250961 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7983bf8-54b3-4e04-b7f0-d7d59941307c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:37.257000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423aa724-56d6-4d35-8e1e-0ecedd487cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:37.257887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aa724-56d6-4d35-8e1e-0ecedd487cce admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:37.258387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aa724-56d6-4d35-8e1e-0ecedd487cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:37.258679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aa724-56d6-4d35-8e1e-0ecedd487cce admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:37.262542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423aa724-56d6-4d35-8e1e-0ecedd487cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:37.262542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423aa724-56d6-4d35-8e1e-0ecedd487cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:37.262542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423aa724-56d6-4d35-8e1e-0ecedd487cce admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:37.276159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1234/2472] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:33:37.281061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53f7d-95a3-4e5d-acc4-ae6aafe3ea73 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:37.292181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53f7d-95a3-4e5d-acc4-ae6aafe3ea73 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:37.301121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206daee-b579-44b4-a557-af9b7893ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:37.301764 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206daee-b579-44b4-a557-af9b7893ddb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:37.302343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206daee-b579-44b4-a557-af9b7893ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:37.302644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206daee-b579-44b4-a557-af9b7893ddb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:37.303318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206daee-b579-44b4-a557-af9b7893ddb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:37.305523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206daee-b579-44b4-a557-af9b7893ddb2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:37.433057 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1239/2473] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:37 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:37.437558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423aa724-56d6-4d35-8e1e-0ecedd487cce admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:37.448468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423aa724-56d6-4d35-8e1e-0ecedd487cce admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:37.496937 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:37.513713 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c285e-dee6-420a-a0ac-f9f11ccea993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:37.514509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c285e-dee6-420a-a0ac-f9f11ccea993 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:37.514790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c285e-dee6-420a-a0ac-f9f11ccea993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:37.515069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c285e-dee6-420a-a0ac-f9f11ccea993 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:37.515707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c285e-dee6-420a-a0ac-f9f11ccea993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:37.517787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c285e-dee6-420a-a0ac-f9f11ccea993 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:37.533044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:37.648752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1235/2474] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:37 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:37.657598 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206daee-b579-44b4-a557-af9b7893ddb2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:37.667852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206daee-b579-44b4-a557-af9b7893ddb2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:37.672450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842b32f-1ccf-4f79-8533-9d767d38b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:37.673042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842b32f-1ccf-4f79-8533-9d767d38b4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:37.673324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842b32f-1ccf-4f79-8533-9d767d38b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:37.673597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842b32f-1ccf-4f79-8533-9d767d38b4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:37.674325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842b32f-1ccf-4f79-8533-9d767d38b4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:37.675990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842b32f-1ccf-4f79-8533-9d767d38b4e6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:37.687304 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1240/2475] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:37.691117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c285e-dee6-420a-a0ac-f9f11ccea993 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:37.701833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c285e-dee6-420a-a0ac-f9f11ccea993 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:37.708477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dac81-a17f-4a62-a142-81e364b609d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:37.708710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dac81-a17f-4a62-a142-81e364b609d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:37.708995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dac81-a17f-4a62-a142-81e364b609d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:37.709272 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dac81-a17f-4a62-a142-81e364b609d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:37.710001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dac81-a17f-4a62-a142-81e364b609d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:37.711678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dac81-a17f-4a62-a142-81e364b609d6 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:37.729279 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1236/2476] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:37.731200 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842b32f-1ccf-4f79-8533-9d767d38b4e6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:37.742458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842b32f-1ccf-4f79-8533-9d767d38b4e6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:37.748247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70463017-48c0-453a-9738-b24ac5cad416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:37.748911 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463017-48c0-453a-9738-b24ac5cad416 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:37.749187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463017-48c0-453a-9738-b24ac5cad416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:37.749451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463017-48c0-453a-9738-b24ac5cad416 admin admin] PATH_INFO: `/v3/projects/02acd9ae6ea546b49d6394ca0a1f85c3/users/fbee2047c370478f8624ab2573adcc72/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:37.765491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70463017-48c0-453a-9738-b24ac5cad416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02acd9ae6ea546b49d6394ca0a1f85c3, user_id=fbee2047c370478f8624ab2573adcc72, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:37.768179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70463017-48c0-453a-9738-b24ac5cad416 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:38.326119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1241/2477] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:37 2022] PUT /identity/v3/projects/02acd9ae6ea546b49d6394ca0a1f85c3/users/fbee2047c370478f8624ab2573adcc72/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:38.336556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2841c26-8b42-4625-930a-737050802f65 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:38.337434 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2841c26-8b42-4625-930a-737050802f65 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:38.337589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2841c26-8b42-4625-930a-737050802f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:38.365310 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a2841c26-8b42-4625-930a-737050802f65 None None] MFA Rules not processed for user `fbee2047c370478f8624ab2573adcc72`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:38.366572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a2841c26-8b42-4625-930a-737050802f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:38.431570 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1237/2478] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:38.436399 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70463017-48c0-453a-9738-b24ac5cad416 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:38.499992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70463017-48c0-453a-9738-b24ac5cad416 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:38.504729 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b1d95-af2c-4ec5-97f6-01af12d87ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:38.505330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b1d95-af2c-4ec5-97f6-01af12d87ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:38.505608 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b1d95-af2c-4ec5-97f6-01af12d87ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:38.505877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b1d95-af2c-4ec5-97f6-01af12d87ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:38.506507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b1d95-af2c-4ec5-97f6-01af12d87ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:38.508469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b1d95-af2c-4ec5-97f6-01af12d87ddb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:38.607349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1242/2479] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:38 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:38.609713 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2841c26-8b42-4625-930a-737050802f65 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:38.622297 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2841c26-8b42-4625-930a-737050802f65 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:38.683117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f94e0-bf14-4fb7-b5f6-00d5c2acdca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:38.683907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f94e0-bf14-4fb7-b5f6-00d5c2acdca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:38.684217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f94e0-bf14-4fb7-b5f6-00d5c2acdca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:38.684490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f94e0-bf14-4fb7-b5f6-00d5c2acdca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:38.685126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f94e0-bf14-4fb7-b5f6-00d5c2acdca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:38.687211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f94e0-bf14-4fb7-b5f6-00d5c2acdca8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:38.791596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1238/2480] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:38 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:38.795425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b1d95-af2c-4ec5-97f6-01af12d87ddb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:38.806008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b1d95-af2c-4ec5-97f6-01af12d87ddb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:38.810835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9c096-a52d-4eaf-afc0-ad418df1e919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:38.812896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c096-a52d-4eaf-afc0-ad418df1e919 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:38.812896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c096-a52d-4eaf-afc0-ad418df1e919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:38.812896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c096-a52d-4eaf-afc0-ad418df1e919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:38.812896 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9c096-a52d-4eaf-afc0-ad418df1e919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:38.814299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9c096-a52d-4eaf-afc0-ad418df1e919 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:38.826589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1243/2481] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:38.830849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f94e0-bf14-4fb7-b5f6-00d5c2acdca8 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:38.842182 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f94e0-bf14-4fb7-b5f6-00d5c2acdca8 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:38.846959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb785b-1b51-4648-8c28-8e7e7c1c2852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:38.847616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb785b-1b51-4648-8c28-8e7e7c1c2852 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:38.847919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb785b-1b51-4648-8c28-8e7e7c1c2852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:38.848200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb785b-1b51-4648-8c28-8e7e7c1c2852 admin admin] PATH_INFO: `/v3/projects/a6370728ee3947fbad34b2bc0b3820f6/users/fe96291fa6934bf899bf7ac09c4139f0/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:38.854254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:38.865321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb785b-1b51-4648-8c28-8e7e7c1c2852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6370728ee3947fbad34b2bc0b3820f6, user_id=fe96291fa6934bf899bf7ac09c4139f0, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:38.868680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb785b-1b51-4648-8c28-8e7e7c1c2852 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:38.914189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:38.976928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1239/2482] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:38 2022] PUT /identity/v3/projects/a6370728ee3947fbad34b2bc0b3820f6/users/fe96291fa6934bf899bf7ac09c4139f0/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:38.981108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9c096-a52d-4eaf-afc0-ad418df1e919 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:38.991617 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9c096-a52d-4eaf-afc0-ad418df1e919 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:39.052663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71920636-a689-4af4-a551-5fdc8779ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:39.053788 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71920636-a689-4af4-a551-5fdc8779ab25 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:39.054065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71920636-a689-4af4-a551-5fdc8779ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:39.054344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71920636-a689-4af4-a551-5fdc8779ab25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:39.054965 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71920636-a689-4af4-a551-5fdc8779ab25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:39.056607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71920636-a689-4af4-a551-5fdc8779ab25 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:39.067114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1244/2483] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:39.072095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb785b-1b51-4648-8c28-8e7e7c1c2852 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:39.083870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb785b-1b51-4648-8c28-8e7e7c1c2852 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:39.088610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b05edf-0721-4936-b870-e8a5e39d2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:39.089371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05edf-0721-4936-b870-e8a5e39d2671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:39.089648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05edf-0721-4936-b870-e8a5e39d2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:39.089944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05edf-0721-4936-b870-e8a5e39d2671 admin admin] PATH_INFO: `/v3/projects/a6370728ee3947fbad34b2bc0b3820f6/users/fe96291fa6934bf899bf7ac09c4139f0/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:39.091868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b05edf-0721-4936-b870-e8a5e39d2671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6370728ee3947fbad34b2bc0b3820f6, user_id=fe96291fa6934bf899bf7ac09c4139f0, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:39.094572 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b05edf-0721-4936-b870-e8a5e39d2671 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:39.105333 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1240/2484] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:39 2022] PUT /identity/v3/projects/a6370728ee3947fbad34b2bc0b3820f6/users/fe96291fa6934bf899bf7ac09c4139f0/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:39.115557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fed426-1c06-4b6c-b619-1df38059a508 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:39.116509 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fed426-1c06-4b6c-b619-1df38059a508 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:39.117253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fed426-1c06-4b6c-b619-1df38059a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:39.149003 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-52fed426-1c06-4b6c-b619-1df38059a508 None None] MFA Rules not processed for user `fe96291fa6934bf899bf7ac09c4139f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:39.150230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-52fed426-1c06-4b6c-b619-1df38059a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:39.220822 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1245/2485] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:39.233263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b05edf-0721-4936-b870-e8a5e39d2671 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:39.237034 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d3b05edf-0721-4936-b870-e8a5e39d2671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:39.300621 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b05edf-0721-4936-b870-e8a5e39d2671 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:39.305165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede1191-0496-460b-bd89-ad123f173f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:39.305775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede1191-0496-460b-bd89-ad123f173f71 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:39.306077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede1191-0496-460b-bd89-ad123f173f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:39.306504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede1191-0496-460b-bd89-ad123f173f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:39.316373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede1191-0496-460b-bd89-ad123f173f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:39.317841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede1191-0496-460b-bd89-ad123f173f71 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:39.327770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1241/2486] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:39.488558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fed426-1c06-4b6c-b619-1df38059a508 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:39.500102 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fed426-1c06-4b6c-b619-1df38059a508 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:39.503708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864c4df-6803-484f-8da9-c765318dc1e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:39.504342 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c4df-6803-484f-8da9-c765318dc1e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:39.504616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c4df-6803-484f-8da9-c765318dc1e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:39.504882 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c4df-6803-484f-8da9-c765318dc1e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:39.538442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:39.563475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864c4df-6803-484f-8da9-c765318dc1e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:39.564946 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864c4df-6803-484f-8da9-c765318dc1e1 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:39.574370 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1246/2487] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:39.606187 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:39.800737 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:40.054137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:40.154874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede1191-0496-460b-bd89-ad123f173f71 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:40.239848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede1191-0496-460b-bd89-ad123f173f71 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:40.244952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:40.245657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:40.246082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:40.246295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] PATH_INFO: `/v3/users/fbee2047c370478f8624ab2573adcc72` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:40.247525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbee2047c370478f8624ab2573adcc72)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:40.249896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:40.425837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:40.434768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbee2047c370478f8624ab2573adcc72'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:40.435421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbee2047c370478f8624ab2573adcc72'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:40.451832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbee2047c370478f8624ab2573adcc72'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:40.459758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbee2047c370478f8624ab2573adcc72'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:40.579973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbee2047c370478f8624ab2573adcc72'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:40.586842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1242/2488] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:40 2022] DELETE /identity/v3/users/fbee2047c370478f8624ab2573adcc72 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:40.591322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c674312-d515-4da3-b8c7-b191272af183 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:40.592835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c674312-d515-4da3-b8c7-b191272af183 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:40.592835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c674312-d515-4da3-b8c7-b191272af183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:40.611612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4c674312-d515-4da3-b8c7-b191272af183 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:40.612846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4c674312-d515-4da3-b8c7-b191272af183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:40.675105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1247/2489] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:40.685227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:40.686628 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:40.749380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca959337-e8d9-4793-90eb-fe072001967e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:40.753126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7e0fb-23e8-4afd-8821-77f94688329d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:40.753729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7e0fb-23e8-4afd-8821-77f94688329d service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:40.754005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7e0fb-23e8-4afd-8821-77f94688329d service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:40.754273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7e0fb-23e8-4afd-8821-77f94688329d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:40.763288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7e0fb-23e8-4afd-8821-77f94688329d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:40.764743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7e0fb-23e8-4afd-8821-77f94688329d service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:40.774664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1243/2490] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:41.199222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:41.311341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c674312-d515-4da3-b8c7-b191272af183 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:41.319384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4c674312-d515-4da3-b8c7-b191272af183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:41.337973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c674312-d515-4da3-b8c7-b191272af183 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:41.337973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:41.338623 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:41.338721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:41.338966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] PATH_INFO: `/v3/projects/02acd9ae6ea546b49d6394ca0a1f85c3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:41.340142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02acd9ae6ea546b49d6394ca0a1f85c3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:41.342090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:41.465855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02acd9ae6ea546b49d6394ca0a1f85c3', 'request_id': 'req-0771af3a-000d-4a9e-a6f0-7d1481687489'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:41.471096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02acd9ae6ea546b49d6394ca0a1f85c3', 'request_id': 'req-0771af3a-000d-4a9e-a6f0-7d1481687489'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:41.478182 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02acd9ae6ea546b49d6394ca0a1f85c3', 'request_id': 'req-0771af3a-000d-4a9e-a6f0-7d1481687489'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:41.593256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] The token cache is being invalidate because project 02acd9ae6ea546b49d6394ca0a1f85c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:41.593932 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:41.594052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:41.595594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1248/2491] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:41 2022] DELETE /identity/v3/projects/02acd9ae6ea546b49d6394ca0a1f85c3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:41.599730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7e0fb-23e8-4afd-8821-77f94688329d service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:41.609919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7e0fb-23e8-4afd-8821-77f94688329d service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:41.617173 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:41.671168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:41.671809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:41.672112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:41.672382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] PATH_INFO: `/v3/users/fe96291fa6934bf899bf7ac09c4139f0` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:41.673525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe96291fa6934bf899bf7ac09c4139f0)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:41.675494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:41.885228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe96291fa6934bf899bf7ac09c4139f0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:41.885825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe96291fa6934bf899bf7ac09c4139f0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:41.893558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:41.898668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe96291fa6934bf899bf7ac09c4139f0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:41.902334 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:41.905781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe96291fa6934bf899bf7ac09c4139f0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:42.031202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe96291fa6934bf899bf7ac09c4139f0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:42.041302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1244/2492] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:41 2022] DELETE /identity/v3/users/fe96291fa6934bf899bf7ac09c4139f0 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:42.302937 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:42.544142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:42.545604 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:42.558527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771af3a-000d-4a9e-a6f0-7d1481687489 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:42.561194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:42.619644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:42.620336 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:42.620621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:42.620948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] PATH_INFO: `/v3/projects/a6370728ee3947fbad34b2bc0b3820f6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:42.622181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6370728ee3947fbad34b2bc0b3820f6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:42.624432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:42.775726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6370728ee3947fbad34b2bc0b3820f6', 'request_id': 'req-239917ee-578d-459b-b5a7-e6b714f3403f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:42.781781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6370728ee3947fbad34b2bc0b3820f6', 'request_id': 'req-239917ee-578d-459b-b5a7-e6b714f3403f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:42.788110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6370728ee3947fbad34b2bc0b3820f6', 'request_id': 'req-239917ee-578d-459b-b5a7-e6b714f3403f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:42.815016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:42.856724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:42.860620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] The token cache is being invalidate because project a6370728ee3947fbad34b2bc0b3820f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:42.860917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:42.861538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-239917ee-578d-459b-b5a7-e6b714f3403f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:42.863082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1249/2493] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:42 2022] DELETE /identity/v3/projects/a6370728ee3947fbad34b2bc0b3820f6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:45.081360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:45.082857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:45.095715 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01111a8-c29f-4549-b3d4-ed9f8008aa36 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:45.163536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:45.164471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:45.164906 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:45.165274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] PATH_INFO: `/v3/users/2ca8a5d5c23c4d81b21bc4a69afe8e86` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:45.166705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca8a5d5c23c4d81b21bc4a69afe8e86)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:45.169467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:45.427676 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca8a5d5c23c4d81b21bc4a69afe8e86'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:45.428492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca8a5d5c23c4d81b21bc4a69afe8e86'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:45.472965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca8a5d5c23c4d81b21bc4a69afe8e86'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:45.486955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca8a5d5c23c4d81b21bc4a69afe8e86'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:45.569563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca8a5d5c23c4d81b21bc4a69afe8e86'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:45.589406 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1245/2494] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:45 2022] DELETE /identity/v3/users/2ca8a5d5c23c4d81b21bc4a69afe8e86 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:45.593743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9779d05-8d5f-4e90-8a17-05798631978a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:45.594211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9779d05-8d5f-4e90-8a17-05798631978a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:45.594400 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9779d05-8d5f-4e90-8a17-05798631978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:45.636137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b9779d05-8d5f-4e90-8a17-05798631978a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:45.641132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b9779d05-8d5f-4e90-8a17-05798631978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:45.747803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1250/2495] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:45.759259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:45.760794 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:45.859829 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e2dda-4e8e-4abc-9151-8111daac0e8c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:45.866563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bb5d-8ef6-4d76-b37f-e9b714d53048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:45.867205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bb5d-8ef6-4d76-b37f-e9b714d53048 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:45.867486 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bb5d-8ef6-4d76-b37f-e9b714d53048 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:45.867783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bb5d-8ef6-4d76-b37f-e9b714d53048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:45.886883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674bb5d-8ef6-4d76-b37f-e9b714d53048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:45.890459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674bb5d-8ef6-4d76-b37f-e9b714d53048 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:45.895120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:45.902788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1246/2496] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:46.320639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9779d05-8d5f-4e90-8a17-05798631978a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:46.322297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b9779d05-8d5f-4e90-8a17-05798631978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:46.334694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9779d05-8d5f-4e90-8a17-05798631978a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:46.339818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:46.349992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:46.349992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:46.349992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] PATH_INFO: `/v3/projects/598e444e7a7f42d7a1f70e1f98fd1330` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:46.349992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=598e444e7a7f42d7a1f70e1f98fd1330)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:46.349992 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:46.447815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598e444e7a7f42d7a1f70e1f98fd1330', 'request_id': 'req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:46.453485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598e444e7a7f42d7a1f70e1f98fd1330', 'request_id': 'req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:46.459700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598e444e7a7f42d7a1f70e1f98fd1330', 'request_id': 'req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:46.528474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] The token cache is being invalidate because project 598e444e7a7f42d7a1f70e1f98fd1330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:46.529884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:46.529884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-37a3bb66-4d66-454c-8f4e-8d0d7cd3ed77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:46.530975 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1251/2497] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:46 2022] DELETE /identity/v3/projects/598e444e7a7f42d7a1f70e1f98fd1330 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:51.350104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bb5d-8ef6-4d76-b37f-e9b714d53048 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:51.351550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8674bb5d-8ef6-4d76-b37f-e9b714d53048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:51.364434 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bb5d-8ef6-4d76-b37f-e9b714d53048 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:51.427117 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:51.427875 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:51.437964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:51.437964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] PATH_INFO: `/v3/users/74522d0113ec4739940403c9c8a8a21f` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:51.437964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74522d0113ec4739940403c9c8a8a21f)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:51.437964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:51.653531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74522d0113ec4739940403c9c8a8a21f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:51.654447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74522d0113ec4739940403c9c8a8a21f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:51.669062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74522d0113ec4739940403c9c8a8a21f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:51.676452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74522d0113ec4739940403c9c8a8a21f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:51.739868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74522d0113ec4739940403c9c8a8a21f'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:51.748611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1247/2498] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:33:51 2022] DELETE /identity/v3/users/74522d0113ec4739940403c9c8a8a21f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:51.753280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129a62-ea53-4297-820c-894c884da7fb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:51.753739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129a62-ea53-4297-820c-894c884da7fb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:51.754011 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129a62-ea53-4297-820c-894c884da7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:51.774282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8f129a62-ea53-4297-820c-894c884da7fb None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:51.775489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8f129a62-ea53-4297-820c-894c884da7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:51.848343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1252/2499] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:51.858152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:51.859541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:51.925368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a79eb-46b2-4294-a806-4a380fea6f70 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:51.929585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e218e9-9a91-466f-bda6-6ac6a55920e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:51.930732 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e218e9-9a91-466f-bda6-6ac6a55920e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:51.931013 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e218e9-9a91-466f-bda6-6ac6a55920e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:51.931283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e218e9-9a91-466f-bda6-6ac6a55920e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:51.940930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e218e9-9a91-466f-bda6-6ac6a55920e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:51.942378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e218e9-9a91-466f-bda6-6ac6a55920e2 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:51.954361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1248/2500] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:52.440011 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129a62-ea53-4297-820c-894c884da7fb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:52.441781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8f129a62-ea53-4297-820c-894c884da7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:52.458639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129a62-ea53-4297-820c-894c884da7fb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:52.465494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:52.466192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:52.466505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:52.466775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] PATH_INFO: `/v3/projects/05575b1ef59e419eaf60e11a31035a80` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:52.468718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=05575b1ef59e419eaf60e11a31035a80)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:52.470281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:52.495570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:52.582011 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05575b1ef59e419eaf60e11a31035a80', 'request_id': 'req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:52.587870 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05575b1ef59e419eaf60e11a31035a80', 'request_id': 'req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:52.593897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05575b1ef59e419eaf60e11a31035a80', 'request_id': 'req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:52.661005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] The token cache is being invalidate because project 05575b1ef59e419eaf60e11a31035a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:33:52.661231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:52.661855 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d9d9a2fc-2673-4bb5-9014-1ca6fb79bc0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:33:52.663351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1253/2501] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:33:52 2022] DELETE /identity/v3/projects/05575b1ef59e419eaf60e11a31035a80 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:52.669067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19905d8b-5086-4078-a2b5-c5e35d7f4bf5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:52.669548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19905d8b-5086-4078-a2b5-c5e35d7f4bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:52.669638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19905d8b-5086-4078-a2b5-c5e35d7f4bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:52.689573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-19905d8b-5086-4078-a2b5-c5e35d7f4bf5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:52.690800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-19905d8b-5086-4078-a2b5-c5e35d7f4bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:52.703971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:52.755603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1249/2502] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:52.764205 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6efd5-c954-4a03-979d-c9e8af30d81f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:52.764781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6efd5-c954-4a03-979d-c9e8af30d81f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:52.764781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6efd5-c954-4a03-979d-c9e8af30d81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:52.785965 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-84a6efd5-c954-4a03-979d-c9e8af30d81f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:52.787199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-84a6efd5-c954-4a03-979d-c9e8af30d81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:52.796151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1254/2503] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:33:52.800566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19905d8b-5086-4078-a2b5-c5e35d7f4bf5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:52.811175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19905d8b-5086-4078-a2b5-c5e35d7f4bf5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:52.816071 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302a57f-a654-4a2b-8c31-ab6bba7d7698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:52.816703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a57f-a654-4a2b-8c31-ab6bba7d7698 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:52.816982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a57f-a654-4a2b-8c31-ab6bba7d7698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:52.817258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302a57f-a654-4a2b-8c31-ab6bba7d7698 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:52.817917 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302a57f-a654-4a2b-8c31-ab6bba7d7698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:33:52.818217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302a57f-a654-4a2b-8c31-ab6bba7d7698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:52.819942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302a57f-a654-4a2b-8c31-ab6bba7d7698 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:52.837276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1250/2504] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:33:52.838793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6efd5-c954-4a03-979d-c9e8af30d81f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:52.848661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6efd5-c954-4a03-979d-c9e8af30d81f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:52.854045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1ca41-646c-4cda-853c-5008217b445f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:52.854647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1ca41-646c-4cda-853c-5008217b445f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:52.855500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1ca41-646c-4cda-853c-5008217b445f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:52.855500 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1ca41-646c-4cda-853c-5008217b445f admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:52.855839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1ca41-646c-4cda-853c-5008217b445f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:52.857778 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1ca41-646c-4cda-853c-5008217b445f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:52.944701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1255/2505] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:33:52 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:52.948950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302a57f-a654-4a2b-8c31-ab6bba7d7698 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:52.960229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302a57f-a654-4a2b-8c31-ab6bba7d7698 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:53.034439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910aaab-73e3-48d2-9ad5-cb56d75262f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:53.035072 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910aaab-73e3-48d2-9ad5-cb56d75262f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:53.035355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910aaab-73e3-48d2-9ad5-cb56d75262f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:53.035623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910aaab-73e3-48d2-9ad5-cb56d75262f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:53.036382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910aaab-73e3-48d2-9ad5-cb56d75262f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:53.038593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910aaab-73e3-48d2-9ad5-cb56d75262f1 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:53.111598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1251/2506] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:33:52 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:33:53.115684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1ca41-646c-4cda-853c-5008217b445f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:53.127473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1ca41-646c-4cda-853c-5008217b445f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:53.133030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e00c9-9515-4ade-a571-38c9cfcea217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:53.133632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e00c9-9515-4ade-a571-38c9cfcea217 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:53.133927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e00c9-9515-4ade-a571-38c9cfcea217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:53.134196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e00c9-9515-4ade-a571-38c9cfcea217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:53.134865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e00c9-9515-4ade-a571-38c9cfcea217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:53.136492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e00c9-9515-4ade-a571-38c9cfcea217 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:53.147261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1256/2507] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:53.151275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910aaab-73e3-48d2-9ad5-cb56d75262f1 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:53.161396 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910aaab-73e3-48d2-9ad5-cb56d75262f1 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:53.166648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7555c48-a324-4e2e-a726-47e82180ee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:53.167245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7555c48-a324-4e2e-a726-47e82180ee92 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:53.167522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7555c48-a324-4e2e-a726-47e82180ee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:53.167793 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7555c48-a324-4e2e-a726-47e82180ee92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:53.168460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7555c48-a324-4e2e-a726-47e82180ee92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:53.170116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7555c48-a324-4e2e-a726-47e82180ee92 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:53.181206 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1252/2508] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:33:53.185210 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e00c9-9515-4ade-a571-38c9cfcea217 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:53.195125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e00c9-9515-4ade-a571-38c9cfcea217 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:53.199728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2e470-83f8-46cd-9ed6-21bce232c228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:53.200402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2e470-83f8-46cd-9ed6-21bce232c228 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:53.200676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2e470-83f8-46cd-9ed6-21bce232c228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:53.200965 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2e470-83f8-46cd-9ed6-21bce232c228 admin admin] PATH_INFO: `/v3/projects/d85ad7c1a41d43129fe7c2ad831bd2da/users/94ccd045000f476a946e15ecf8babd85/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:53.216957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2e470-83f8-46cd-9ed6-21bce232c228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85ad7c1a41d43129fe7c2ad831bd2da, user_id=94ccd045000f476a946e15ecf8babd85, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:53.219877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2e470-83f8-46cd-9ed6-21bce232c228 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:53.299784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1257/2509] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:33:53 2022] PUT /identity/v3/projects/d85ad7c1a41d43129fe7c2ad831bd2da/users/94ccd045000f476a946e15ecf8babd85/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:33:53.311000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757753e6-332e-4f6e-aa94-75736e586775 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:53.311283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757753e6-332e-4f6e-aa94-75736e586775 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:53.311585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757753e6-332e-4f6e-aa94-75736e586775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:53.341382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-757753e6-332e-4f6e-aa94-75736e586775 None None] MFA Rules not processed for user `94ccd045000f476a946e15ecf8babd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:53.342598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-757753e6-332e-4f6e-aa94-75736e586775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:53.407164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1253/2510] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:33:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:53.418631 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2e470-83f8-46cd-9ed6-21bce232c228 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:53.420452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-aea2e470-83f8-46cd-9ed6-21bce232c228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:53.478224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2e470-83f8-46cd-9ed6-21bce232c228 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:53.482255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d182c6e-31b2-4285-b115-1320251a0fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:53.482863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d182c6e-31b2-4285-b115-1320251a0fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:53.483146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d182c6e-31b2-4285-b115-1320251a0fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:53.483413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d182c6e-31b2-4285-b115-1320251a0fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:53.492532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d182c6e-31b2-4285-b115-1320251a0fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:53.494243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d182c6e-31b2-4285-b115-1320251a0fe7 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:53.503721 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1258/2511] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:33:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:33:56.053251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c88822-8320-4ee6-8c59-e0cf0a63a782 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:56.055337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c88822-8320-4ee6-8c59-e0cf0a63a782 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:56.055860 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c88822-8320-4ee6-8c59-e0cf0a63a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:56.082956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-32c88822-8320-4ee6-8c59-e0cf0a63a782 None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:56.084652 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-32c88822-8320-4ee6-8c59-e0cf0a63a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:56.096175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:56.182202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1254/2512] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:33:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:56.244684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d182c6e-31b2-4285-b115-1320251a0fe7 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:56.246139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7d182c6e-31b2-4285-b115-1320251a0fe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:56.306736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:56.330949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d182c6e-31b2-4285-b115-1320251a0fe7 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:56.336917 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134213e-c493-4e3e-9fc2-85d95f2c344c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:56.337692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134213e-c493-4e3e-9fc2-85d95f2c344c service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:56.339284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134213e-c493-4e3e-9fc2-85d95f2c344c service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:56.339571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134213e-c493-4e3e-9fc2-85d95f2c344c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:56.348725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134213e-c493-4e3e-9fc2-85d95f2c344c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:56.350635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134213e-c493-4e3e-9fc2-85d95f2c344c service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:56.360056 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1259/2513] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:33:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:33:57.376417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10a4f9-49dd-47f0-9e12-b1e5bac4a94b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:57.377425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10a4f9-49dd-47f0-9e12-b1e5bac4a94b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:57.378014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10a4f9-49dd-47f0-9e12-b1e5bac4a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:57.405234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6d10a4f9-49dd-47f0-9e12-b1e5bac4a94b None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:57.406994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6d10a4f9-49dd-47f0-9e12-b1e5bac4a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:57.422925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1255/2514] 10.222.0.55 () {58 vars in 967 bytes} [Fri Sep 2 09:33:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:57.433154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134213e-c493-4e3e-9fc2-85d95f2c344c service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:57.449747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134213e-c493-4e3e-9fc2-85d95f2c344c service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:57.455386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a24fc8-aad2-4a5c-8c71-836bd3e84c17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:57.456247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a24fc8-aad2-4a5c-8c71-836bd3e84c17 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:57.456699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a24fc8-aad2-4a5c-8c71-836bd3e84c17 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:57.457131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a24fc8-aad2-4a5c-8c71-836bd3e84c17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:57.467212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a24fc8-aad2-4a5c-8c71-836bd3e84c17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:57.469645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a24fc8-aad2-4a5c-8c71-836bd3e84c17 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:57.479918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1260/2515] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:33:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:33:58.255843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb120038-6df9-41d2-8f82-09cec3ed4e66 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:58.256157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb120038-6df9-41d2-8f82-09cec3ed4e66 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:58.256432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb120038-6df9-41d2-8f82-09cec3ed4e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:58.275805 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-fb120038-6df9-41d2-8f82-09cec3ed4e66 None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:58.277025 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fb120038-6df9-41d2-8f82-09cec3ed4e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:58.284319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1256/2516] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:33:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:58.296599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a24fc8-aad2-4a5c-8c71-836bd3e84c17 service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:58.307642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a24fc8-aad2-4a5c-8c71-836bd3e84c17 service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:58.312739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f493d25-ab1f-4bbd-a967-7649904dbd8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:58.313327 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493d25-ab1f-4bbd-a967-7649904dbd8d service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:58.313603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493d25-ab1f-4bbd-a967-7649904dbd8d service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:58.317582 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f493d25-ab1f-4bbd-a967-7649904dbd8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:58.321703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f493d25-ab1f-4bbd-a967-7649904dbd8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:58.323299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f493d25-ab1f-4bbd-a967-7649904dbd8d service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:58.331128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1261/2517] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:33:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:33:58.927196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1672f37-0bfc-4c97-bf7f-39dfc78d80f1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:58.927773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1672f37-0bfc-4c97-bf7f-39dfc78d80f1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:58.927773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1672f37-0bfc-4c97-bf7f-39dfc78d80f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:58.947309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c1672f37-0bfc-4c97-bf7f-39dfc78d80f1 None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:33:58.948531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c1672f37-0bfc-4c97-bf7f-39dfc78d80f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:33:58.955576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1257/2518] 10.222.0.55 () {58 vars in 967 bytes} [Fri Sep 2 09:33:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:33:58.968357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f493d25-ab1f-4bbd-a967-7649904dbd8d service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:33:58.978874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f493d25-ab1f-4bbd-a967-7649904dbd8d service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:33:58.983876 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d98cd8-1288-4e6d-9449-1e1000ad8470 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:33:58.984495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d98cd8-1288-4e6d-9449-1e1000ad8470 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:33:58.984784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d98cd8-1288-4e6d-9449-1e1000ad8470 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:33:58.985042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d98cd8-1288-4e6d-9449-1e1000ad8470 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:33:58.993363 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d98cd8-1288-4e6d-9449-1e1000ad8470 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:33:58.995330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d98cd8-1288-4e6d-9449-1e1000ad8470 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:33:59.003740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1262/2519] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:33:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:34:01.615657 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1672f37-0bfc-4c97-bf7f-39dfc78d80f1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:01.617283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c1672f37-0bfc-4c97-bf7f-39dfc78d80f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:01.692722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1672f37-0bfc-4c97-bf7f-39dfc78d80f1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:01.697463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:01.698098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:01.698377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:01.698655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] PATH_INFO: `/v3/users/63b69198ca614c4eb0b6b400499c1ab1` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:01.699799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b69198ca614c4eb0b6b400499c1ab1)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:01.701779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:01.924447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b69198ca614c4eb0b6b400499c1ab1'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:01.925022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b69198ca614c4eb0b6b400499c1ab1'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:01.936806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b69198ca614c4eb0b6b400499c1ab1'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:01.944028 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b69198ca614c4eb0b6b400499c1ab1'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:02.019680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b69198ca614c4eb0b6b400499c1ab1'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:02.027648 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1258/2520] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:34:01 2022] DELETE /identity/v3/users/63b69198ca614c4eb0b6b400499c1ab1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:34:02.032139 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682be57-bf68-4c14-a5a8-f4b4812a4fe9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:02.032602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682be57-bf68-4c14-a5a8-f4b4812a4fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:02.032736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682be57-bf68-4c14-a5a8-f4b4812a4fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:02.052166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2682be57-bf68-4c14-a5a8-f4b4812a4fe9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:02.053456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2682be57-bf68-4c14-a5a8-f4b4812a4fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:02.112794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1263/2521] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:02.123764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:02.125299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:02.150784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:02.193769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f262a-5fc0-430e-8a17-d8b6b89fd1a9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:02.198053 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abd3e8-bff9-4643-8c42-e1f5bc7aa0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:02.198662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd3e8-bff9-4643-8c42-e1f5bc7aa0fa service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:02.198944 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd3e8-bff9-4643-8c42-e1f5bc7aa0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:02.199211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd3e8-bff9-4643-8c42-e1f5bc7aa0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:02.208487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abd3e8-bff9-4643-8c42-e1f5bc7aa0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:02.209942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abd3e8-bff9-4643-8c42-e1f5bc7aa0fa service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:02.220146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1259/2522] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:34:02.455396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682be57-bf68-4c14-a5a8-f4b4812a4fe9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:02.456981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2682be57-bf68-4c14-a5a8-f4b4812a4fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:02.470394 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682be57-bf68-4c14-a5a8-f4b4812a4fe9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:02.475252 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:02.475900 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:02.476193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:02.476462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] PATH_INFO: `/v3/projects/219868ca971446758f29feaf14568afd` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:02.477656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219868ca971446758f29feaf14568afd)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:02.482120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:02.603523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219868ca971446758f29feaf14568afd', 'request_id': 'req-925cd329-61d7-44c4-941b-85522dcae5b7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:02.609206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219868ca971446758f29feaf14568afd', 'request_id': 'req-925cd329-61d7-44c4-941b-85522dcae5b7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:02.615563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219868ca971446758f29feaf14568afd', 'request_id': 'req-925cd329-61d7-44c4-941b-85522dcae5b7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:02.704462 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] The token cache is being invalidate because project 219868ca971446758f29feaf14568afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:34:02.704661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:02.705344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-925cd329-61d7-44c4-941b-85522dcae5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:02.706928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1264/2523] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:34:02 2022] DELETE /identity/v3/projects/219868ca971446758f29feaf14568afd => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:34:02.711718 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b9ba-3f7d-42b9-bd69-31bb7735046c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:02.712226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b9ba-3f7d-42b9-bd69-31bb7735046c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:02.712320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b9ba-3f7d-42b9-bd69-31bb7735046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:02.732252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-fe91b9ba-3f7d-42b9-bd69-31bb7735046c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:02.733471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fe91b9ba-3f7d-42b9-bd69-31bb7735046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:02.799014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1260/2524] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:02.807372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f3d7-666f-4b7a-9cc1-e139e161354f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:02.807653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f3d7-666f-4b7a-9cc1-e139e161354f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:02.807954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f3d7-666f-4b7a-9cc1-e139e161354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:02.828211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1a17f3d7-666f-4b7a-9cc1-e139e161354f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:02.829419 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1a17f3d7-666f-4b7a-9cc1-e139e161354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:02.837587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1265/2525] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:02.841842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b9ba-3f7d-42b9-bd69-31bb7735046c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:02.852097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b9ba-3f7d-42b9-bd69-31bb7735046c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:02.856598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d7eb-3f43-4f0f-89fd-588669e91ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:02.857189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d7eb-3f43-4f0f-89fd-588669e91ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:02.857463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d7eb-3f43-4f0f-89fd-588669e91ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:02.857732 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d7eb-3f43-4f0f-89fd-588669e91ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:02.858368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d7eb-3f43-4f0f-89fd-588669e91ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:34:02.858664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d7eb-3f43-4f0f-89fd-588669e91ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:02.860303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d7eb-3f43-4f0f-89fd-588669e91ee8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:02.873082 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1261/2526] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:34:02.877433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17f3d7-666f-4b7a-9cc1-e139e161354f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:02.887132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17f3d7-666f-4b7a-9cc1-e139e161354f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:02.891811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b2916-ccbd-4f4f-89c7-676a76c9e280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:02.892433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b2916-ccbd-4f4f-89c7-676a76c9e280 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:02.892711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b2916-ccbd-4f4f-89c7-676a76c9e280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:02.892981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b2916-ccbd-4f4f-89c7-676a76c9e280 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:02.893597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b2916-ccbd-4f4f-89c7-676a76c9e280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:02.895513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b2916-ccbd-4f4f-89c7-676a76c9e280 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:02.907199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:02.995488 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1266/2527] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:34:02 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:34:03.000151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d7eb-3f43-4f0f-89fd-588669e91ee8 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:03.011364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d7eb-3f43-4f0f-89fd-588669e91ee8 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:03.070079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db124be0-7520-4958-9b54-249dd598dc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:03.071292 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db124be0-7520-4958-9b54-249dd598dc60 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:03.071564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db124be0-7520-4958-9b54-249dd598dc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:03.071872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db124be0-7520-4958-9b54-249dd598dc60 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:03.072509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db124be0-7520-4958-9b54-249dd598dc60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:03.074417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db124be0-7520-4958-9b54-249dd598dc60 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:03.146842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1262/2528] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:34:02 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:34:03.149576 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b2916-ccbd-4f4f-89c7-676a76c9e280 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:03.159799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b2916-ccbd-4f4f-89c7-676a76c9e280 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:03.164411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f709c4b-78a0-48d9-89e4-bcd65d002503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:03.165002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f709c4b-78a0-48d9-89e4-bcd65d002503 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:03.165278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f709c4b-78a0-48d9-89e4-bcd65d002503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:03.165546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f709c4b-78a0-48d9-89e4-bcd65d002503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:03.166170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f709c4b-78a0-48d9-89e4-bcd65d002503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:03.167756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f709c4b-78a0-48d9-89e4-bcd65d002503 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:03.177916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1267/2529] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:34:03.182553 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db124be0-7520-4958-9b54-249dd598dc60 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:03.192461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db124be0-7520-4958-9b54-249dd598dc60 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:03.197862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9bd3b-8556-4673-9be2-16319d63741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:03.198452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9bd3b-8556-4673-9be2-16319d63741d admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:03.198728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9bd3b-8556-4673-9be2-16319d63741d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:03.199000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9bd3b-8556-4673-9be2-16319d63741d admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:03.199760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9bd3b-8556-4673-9be2-16319d63741d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:03.201385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9bd3b-8556-4673-9be2-16319d63741d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:03.212895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1263/2530] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:34:03.217422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f709c4b-78a0-48d9-89e4-bcd65d002503 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:03.228323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f709c4b-78a0-48d9-89e4-bcd65d002503 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:03.233280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55550bae-6eba-476d-be22-bb21e26edc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:03.233941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55550bae-6eba-476d-be22-bb21e26edc5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:03.234218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55550bae-6eba-476d-be22-bb21e26edc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:03.234492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55550bae-6eba-476d-be22-bb21e26edc5e admin admin] PATH_INFO: `/v3/projects/66f5c53e44c44598ba4859e68837a906/users/f01435add421460ca4e08cd7c3790a83/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:03.250913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55550bae-6eba-476d-be22-bb21e26edc5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f5c53e44c44598ba4859e68837a906, user_id=f01435add421460ca4e08cd7c3790a83, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:03.253874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55550bae-6eba-476d-be22-bb21e26edc5e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:03.331326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1268/2531] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:34:03 2022] PUT /identity/v3/projects/66f5c53e44c44598ba4859e68837a906/users/f01435add421460ca4e08cd7c3790a83/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:34:03.342328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0116-9d85-4c5c-96f6-712ad044e489 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:03.342614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0116-9d85-4c5c-96f6-712ad044e489 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:03.342892 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0116-9d85-4c5c-96f6-712ad044e489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:03.373064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-658e0116-9d85-4c5c-96f6-712ad044e489 None None] MFA Rules not processed for user `f01435add421460ca4e08cd7c3790a83`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:03.374347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-658e0116-9d85-4c5c-96f6-712ad044e489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:03.391024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:03.438506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1264/2532] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:34:03.450487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55550bae-6eba-476d-be22-bb21e26edc5e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:03.452243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-55550bae-6eba-476d-be22-bb21e26edc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:03.512899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55550bae-6eba-476d-be22-bb21e26edc5e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:03.516840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aebf47-3075-4425-b556-11790b0e64d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:03.517450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aebf47-3075-4425-b556-11790b0e64d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:03.517725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aebf47-3075-4425-b556-11790b0e64d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:03.518020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aebf47-3075-4425-b556-11790b0e64d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:03.527013 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aebf47-3075-4425-b556-11790b0e64d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:03.528479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aebf47-3075-4425-b556-11790b0e64d9 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:03.537645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1269/2533] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:34:05.652415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0116-9d85-4c5c-96f6-712ad044e489 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:05.653962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-658e0116-9d85-4c5c-96f6-712ad044e489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:05.720544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0116-9d85-4c5c-96f6-712ad044e489 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:05.724996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:05.725618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:05.725890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:05.726160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] PATH_INFO: `/v3/users/94ccd045000f476a946e15ecf8babd85` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:05.727789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ccd045000f476a946e15ecf8babd85)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:05.729735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:05.961681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ccd045000f476a946e15ecf8babd85'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:05.962340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ccd045000f476a946e15ecf8babd85'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:05.974092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ccd045000f476a946e15ecf8babd85'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:05.982021 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ccd045000f476a946e15ecf8babd85'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:06.056452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ccd045000f476a946e15ecf8babd85'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:06.063159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1265/2534] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:34:05 2022] DELETE /identity/v3/users/94ccd045000f476a946e15ecf8babd85 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:34:06.067743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb612c-2b32-443c-8443-bae7437f9799 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:06.068287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb612c-2b32-443c-8443-bae7437f9799 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:06.068384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb612c-2b32-443c-8443-bae7437f9799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:06.087830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-31cb612c-2b32-443c-8443-bae7437f9799 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:06.089044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-31cb612c-2b32-443c-8443-bae7437f9799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:06.147907 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1270/2535] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:06.158630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:06.160250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:06.203605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:06.219546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa30b9-95e0-4b39-9b91-33bb7728a72b admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:06.223531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22866aa-d1ad-4dc4-85b1-085d57e98b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:06.224223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22866aa-d1ad-4dc4-85b1-085d57e98b9e service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:06.224440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22866aa-d1ad-4dc4-85b1-085d57e98b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:06.224708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22866aa-d1ad-4dc4-85b1-085d57e98b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:06.234807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22866aa-d1ad-4dc4-85b1-085d57e98b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:06.236279 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22866aa-d1ad-4dc4-85b1-085d57e98b9e service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:06.246458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1266/2536] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:34:06.535969 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb612c-2b32-443c-8443-bae7437f9799 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:06.546089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb612c-2b32-443c-8443-bae7437f9799 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:06.549886 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79b2c1-e641-481c-a0bf-860ba9c6280e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:06.550522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b2c1-e641-481c-a0bf-860ba9c6280e service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:06.550802 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b2c1-e641-481c-a0bf-860ba9c6280e service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:06.551073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b2c1-e641-481c-a0bf-860ba9c6280e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:06.552863 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ee79b2c1-e641-481c-a0bf-860ba9c6280e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:06.615958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:06.619949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79b2c1-e641-481c-a0bf-860ba9c6280e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:06.621387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79b2c1-e641-481c-a0bf-860ba9c6280e service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:06.631076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1271/2537] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:34:06.676247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22866aa-d1ad-4dc4-85b1-085d57e98b9e service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:06.677912 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b22866aa-d1ad-4dc4-85b1-085d57e98b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:06.691388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22866aa-d1ad-4dc4-85b1-085d57e98b9e service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:06.697161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:06.698010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:06.698269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:06.698545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] PATH_INFO: `/v3/projects/d85ad7c1a41d43129fe7c2ad831bd2da` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:06.699680 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85ad7c1a41d43129fe7c2ad831bd2da)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:06.701623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:06.815844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85ad7c1a41d43129fe7c2ad831bd2da', 'request_id': 'req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:06.828611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85ad7c1a41d43129fe7c2ad831bd2da', 'request_id': 'req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:06.843079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85ad7c1a41d43129fe7c2ad831bd2da', 'request_id': 'req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:06.919509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] The token cache is being invalidate because project d85ad7c1a41d43129fe7c2ad831bd2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:34:06.919996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:06.920668 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e5797454-1542-4bb4-ac6f-1b1d2fd311e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:06.922213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1267/2538] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:34:06 2022] DELETE /identity/v3/projects/d85ad7c1a41d43129fe7c2ad831bd2da => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:34:06.927127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b414fc-c480-4f47-9459-7d0d1e658aed None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:06.927441 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b414fc-c480-4f47-9459-7d0d1e658aed None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:06.927715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b414fc-c480-4f47-9459-7d0d1e658aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:06.948537 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e1b414fc-c480-4f47-9459-7d0d1e658aed None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:06.949743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e1b414fc-c480-4f47-9459-7d0d1e658aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:07.011875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1272/2539] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:07.019739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26f57-781c-469c-ae76-46e15e1a64f8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:07.020122 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26f57-781c-469c-ae76-46e15e1a64f8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:07.020560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26f57-781c-469c-ae76-46e15e1a64f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:07.040941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1de26f57-781c-469c-ae76-46e15e1a64f8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:07.042151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1de26f57-781c-469c-ae76-46e15e1a64f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:07.054176 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1268/2540] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:07.057655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b414fc-c480-4f47-9459-7d0d1e658aed None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:07.067320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b414fc-c480-4f47-9459-7d0d1e658aed None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:07.072719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23a6f4-f706-4221-a40c-a78f61404b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:07.074044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23a6f4-f706-4221-a40c-a78f61404b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:07.074524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23a6f4-f706-4221-a40c-a78f61404b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:07.075010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23a6f4-f706-4221-a40c-a78f61404b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:07.075849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23a6f4-f706-4221-a40c-a78f61404b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:34:07.076248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23a6f4-f706-4221-a40c-a78f61404b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:07.078091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23a6f4-f706-4221-a40c-a78f61404b33 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:07.094023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1273/2541] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:34:07.095312 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de26f57-781c-469c-ae76-46e15e1a64f8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:07.105747 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de26f57-781c-469c-ae76-46e15e1a64f8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:07.112442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95cb6b-f70e-4ce8-8691-cbf12d6255b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:07.113451 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95cb6b-f70e-4ce8-8691-cbf12d6255b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:07.113729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95cb6b-f70e-4ce8-8691-cbf12d6255b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:07.113994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95cb6b-f70e-4ce8-8691-cbf12d6255b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:07.115446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95cb6b-f70e-4ce8-8691-cbf12d6255b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:07.118150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95cb6b-f70e-4ce8-8691-cbf12d6255b5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:07.245969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1269/2542] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:34:07 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:34:07.250209 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23a6f4-f706-4221-a40c-a78f61404b33 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:07.260291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23a6f4-f706-4221-a40c-a78f61404b33 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:07.319564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96afa2-c56a-4668-893b-042563c8194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:07.320130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96afa2-c56a-4668-893b-042563c8194d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:07.320478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96afa2-c56a-4668-893b-042563c8194d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:07.320883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96afa2-c56a-4668-893b-042563c8194d admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:07.321509 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96afa2-c56a-4668-893b-042563c8194d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:07.323410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96afa2-c56a-4668-893b-042563c8194d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:07.408217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1274/2543] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:34:07 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:34:07.409518 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95cb6b-f70e-4ce8-8691-cbf12d6255b5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:07.420719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95cb6b-f70e-4ce8-8691-cbf12d6255b5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:07.425673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04b740-aeb5-425e-8c60-bb654fb2b432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:07.426283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b740-aeb5-425e-8c60-bb654fb2b432 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:07.426582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b740-aeb5-425e-8c60-bb654fb2b432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:07.426857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b740-aeb5-425e-8c60-bb654fb2b432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:07.427506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04b740-aeb5-425e-8c60-bb654fb2b432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:07.429158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04b740-aeb5-425e-8c60-bb654fb2b432 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:07.440042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1270/2544] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:34:07.444006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96afa2-c56a-4668-893b-042563c8194d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:07.454215 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96afa2-c56a-4668-893b-042563c8194d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:07.459762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8d606-c804-4a6b-bc46-ca5f273bf8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:07.463571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d606-c804-4a6b-bc46-ca5f273bf8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:07.463571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d606-c804-4a6b-bc46-ca5f273bf8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:07.463571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d606-c804-4a6b-bc46-ca5f273bf8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:07.463571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8d606-c804-4a6b-bc46-ca5f273bf8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:07.463986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8d606-c804-4a6b-bc46-ca5f273bf8f3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:07.475232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1275/2545] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:34:07.480030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04b740-aeb5-425e-8c60-bb654fb2b432 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:07.490179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04b740-aeb5-425e-8c60-bb654fb2b432 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:07.496088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed70d-3ed6-4817-b8bb-4aaf8fff43f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:07.496743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed70d-3ed6-4817-b8bb-4aaf8fff43f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:07.497019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed70d-3ed6-4817-b8bb-4aaf8fff43f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:07.497289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed70d-3ed6-4817-b8bb-4aaf8fff43f7 admin admin] PATH_INFO: `/v3/projects/68a117d902b642a6aee8248ede5b5fd4/users/15d952b7834e4bda878b120e6b176b2c/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:07.512161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed70d-3ed6-4817-b8bb-4aaf8fff43f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a117d902b642a6aee8248ede5b5fd4, user_id=15d952b7834e4bda878b120e6b176b2c, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:07.514833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed70d-3ed6-4817-b8bb-4aaf8fff43f7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:07.640389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1271/2546] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:34:07 2022] PUT /identity/v3/projects/68a117d902b642a6aee8248ede5b5fd4/users/15d952b7834e4bda878b120e6b176b2c/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:34:07.645391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c5304-c4e3-4883-9d42-62fbc7851156 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:07.645685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c5304-c4e3-4883-9d42-62fbc7851156 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:07.645985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c5304-c4e3-4883-9d42-62fbc7851156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:07.666065 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9f6c5304-c4e3-4883-9d42-62fbc7851156 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:07.667253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9f6c5304-c4e3-4883-9d42-62fbc7851156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:07.716715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:07.728852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1276/2547] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:34:07.750730 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed70d-3ed6-4817-b8bb-4aaf8fff43f7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:07.752574 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c97ed70d-3ed6-4817-b8bb-4aaf8fff43f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:07.811573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed70d-3ed6-4817-b8bb-4aaf8fff43f7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:07.815533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ced8c-36b2-413d-af62-c51dacfede7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:07.816233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ced8c-36b2-413d-af62-c51dacfede7c service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:07.816513 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ced8c-36b2-413d-af62-c51dacfede7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:07.816816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ced8c-36b2-413d-af62-c51dacfede7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:07.833588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ced8c-36b2-413d-af62-c51dacfede7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:07.835065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ced8c-36b2-413d-af62-c51dacfede7c service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:07.846308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1272/2548] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:34:10.231034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062b9d-4e95-43dc-8ed0-cd644d78c7c0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:10.231034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062b9d-4e95-43dc-8ed0-cd644d78c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:10.231034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062b9d-4e95-43dc-8ed0-cd644d78c7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:10.259384 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4d062b9d-4e95-43dc-8ed0-cd644d78c7c0 None None] MFA Rules not processed for user `15d952b7834e4bda878b120e6b176b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:10.260897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4d062b9d-4e95-43dc-8ed0-cd644d78c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:10.342156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1277/2549] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:10.353045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ced8c-36b2-413d-af62-c51dacfede7c service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:10.354869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c69ced8c-36b2-413d-af62-c51dacfede7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:10.361643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:10.427536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ced8c-36b2-413d-af62-c51dacfede7c service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:10.431820 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebedcc2-8fdc-4ca1-9dea-edac54b31ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:10.435104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebedcc2-8fdc-4ca1-9dea-edac54b31ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:10.435104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebedcc2-8fdc-4ca1-9dea-edac54b31ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:10.435104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebedcc2-8fdc-4ca1-9dea-edac54b31ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:10.442760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebedcc2-8fdc-4ca1-9dea-edac54b31ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:10.444238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebedcc2-8fdc-4ca1-9dea-edac54b31ff2 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:10.454686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1273/2550] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:34:12.255887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7089e-be23-474e-a1cf-ef1a7dfab33a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:12.256386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7089e-be23-474e-a1cf-ef1a7dfab33a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:12.256480 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7089e-be23-474e-a1cf-ef1a7dfab33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:12.276348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bfe7089e-be23-474e-a1cf-ef1a7dfab33a None None] MFA Rules not processed for user `15d952b7834e4bda878b120e6b176b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:12.277920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bfe7089e-be23-474e-a1cf-ef1a7dfab33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:12.285541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1278/2551] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:15.727148 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebedcc2-8fdc-4ca1-9dea-edac54b31ff2 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:15.728661 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6ebedcc2-8fdc-4ca1-9dea-edac54b31ff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:15.742690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebedcc2-8fdc-4ca1-9dea-edac54b31ff2 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:15.748356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:15.748984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:15.749262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:15.749672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] PATH_INFO: `/v3/users/f01435add421460ca4e08cd7c3790a83` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:15.750855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01435add421460ca4e08cd7c3790a83)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:15.752867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:15.925950 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01435add421460ca4e08cd7c3790a83'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:15.926696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01435add421460ca4e08cd7c3790a83'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:15.939293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01435add421460ca4e08cd7c3790a83'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:15.946183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01435add421460ca4e08cd7c3790a83'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:16.002216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01435add421460ca4e08cd7c3790a83'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:16.008928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1274/2552] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:34:15 2022] DELETE /identity/v3/users/f01435add421460ca4e08cd7c3790a83 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:34:16.014132 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c59e-ec90-49b0-a621-3ba45e677806 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:16.014592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c59e-ec90-49b0-a621-3ba45e677806 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:16.014866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c59e-ec90-49b0-a621-3ba45e677806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:16.034136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5422c59e-ec90-49b0-a621-3ba45e677806 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:16.035338 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5422c59e-ec90-49b0-a621-3ba45e677806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:16.093412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1279/2553] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:34:16.107659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:16.107659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:16.166340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcbc36-5194-4d69-ace2-708f0037e95e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:16.170167 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74ce34-185e-4ee4-b5ba-9cdfc33e4776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:16.170852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74ce34-185e-4ee4-b5ba-9cdfc33e4776 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:16.171130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74ce34-185e-4ee4-b5ba-9cdfc33e4776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:16.171401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74ce34-185e-4ee4-b5ba-9cdfc33e4776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:16.184137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74ce34-185e-4ee4-b5ba-9cdfc33e4776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:16.185602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74ce34-185e-4ee4-b5ba-9cdfc33e4776 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:16.195787 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1275/2554] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:34:16.726828 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c59e-ec90-49b0-a621-3ba45e677806 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:16.732641 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5422c59e-ec90-49b0-a621-3ba45e677806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:16.741381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c59e-ec90-49b0-a621-3ba45e677806 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:16.747073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:16.747755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:16.748039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:16.748310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] PATH_INFO: `/v3/projects/66f5c53e44c44598ba4859e68837a906` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:16.749550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f5c53e44c44598ba4859e68837a906)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:16.751389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:16.870185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f5c53e44c44598ba4859e68837a906', 'request_id': 'req-8ca0addb-1c0f-4e14-b729-7e7920d27d29'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:16.876924 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f5c53e44c44598ba4859e68837a906', 'request_id': 'req-8ca0addb-1c0f-4e14-b729-7e7920d27d29'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:16.883274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f5c53e44c44598ba4859e68837a906', 'request_id': 'req-8ca0addb-1c0f-4e14-b729-7e7920d27d29'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:16.967978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] The token cache is being invalidate because project 66f5c53e44c44598ba4859e68837a906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:34:16.968269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:16.968882 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:34:16.970380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1280/2555] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:34:16 2022] DELETE /identity/v3/projects/66f5c53e44c44598ba4859e68837a906 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:34:26.191189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:26.964899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:46.802502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637598fc-9bf9-4014-a53e-dd64a33bb44c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:46.803078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637598fc-9bf9-4014-a53e-dd64a33bb44c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:46.803078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637598fc-9bf9-4014-a53e-dd64a33bb44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:46.823533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-637598fc-9bf9-4014-a53e-dd64a33bb44c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:46.824929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-637598fc-9bf9-4014-a53e-dd64a33bb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:46.893683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1276/2556] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:46.915244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:46.916760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:46.987164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0addb-1c0f-4e14-b729-7e7920d27d29 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:46.992653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343789-bfc2-43ef-954d-a6dfc4545224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:46.993279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343789-bfc2-43ef-954d-a6dfc4545224 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:46.993557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343789-bfc2-43ef-954d-a6dfc4545224 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:46.993826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343789-bfc2-43ef-954d-a6dfc4545224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:47.002772 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70343789-bfc2-43ef-954d-a6dfc4545224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:47.004356 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70343789-bfc2-43ef-954d-a6dfc4545224 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:47.014325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1281/2557] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:34:51.093549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13d57-3e67-424c-9942-c6a1b482a47a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:51.094066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13d57-3e67-424c-9942-c6a1b482a47a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:51.094159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13d57-3e67-424c-9942-c6a1b482a47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:51.113208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-9dd13d57-3e67-424c-9942-c6a1b482a47a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:51.114407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9dd13d57-3e67-424c-9942-c6a1b482a47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:51.122432 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1277/2558] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:51.157578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343789-bfc2-43ef-954d-a6dfc4545224 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:51.169154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343789-bfc2-43ef-954d-a6dfc4545224 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:51.174790 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec81b13-43f7-49b9-8313-59278a6b1b9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:51.175378 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec81b13-43f7-49b9-8313-59278a6b1b9d service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:51.175655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec81b13-43f7-49b9-8313-59278a6b1b9d service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:51.175959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec81b13-43f7-49b9-8313-59278a6b1b9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:51.183859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec81b13-43f7-49b9-8313-59278a6b1b9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:51.185449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec81b13-43f7-49b9-8313-59278a6b1b9d service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:51.195120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1282/2559] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:34:54.627635 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c48c-8e62-449c-ac2a-d7908b03dbb4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:54.628217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c48c-8e62-449c-ac2a-d7908b03dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:54.628217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c48c-8e62-449c-ac2a-d7908b03dbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:54.647326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a451c48c-8e62-449c-ac2a-d7908b03dbb4 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:54.648548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a451c48c-8e62-449c-ac2a-d7908b03dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:54.656270 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1278/2560] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:54.686883 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec81b13-43f7-49b9-8313-59278a6b1b9d service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:54.698346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec81b13-43f7-49b9-8313-59278a6b1b9d service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:54.703748 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531da1d-d05f-4c42-9676-e0a5ce4c70f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:54.704380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531da1d-d05f-4c42-9676-e0a5ce4c70f7 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:54.704654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531da1d-d05f-4c42-9676-e0a5ce4c70f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:54.704981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531da1d-d05f-4c42-9676-e0a5ce4c70f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:54.712792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531da1d-d05f-4c42-9676-e0a5ce4c70f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:54.714333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531da1d-d05f-4c42-9676-e0a5ce4c70f7 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:54.723528 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1283/2561] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:34:57.495781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f79d-34bf-4a8a-846e-6089eadd7d94 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:57.496299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f79d-34bf-4a8a-846e-6089eadd7d94 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:57.501538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f79d-34bf-4a8a-846e-6089eadd7d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:57.516022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-57c0f79d-34bf-4a8a-846e-6089eadd7d94 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:34:57.517903 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-57c0f79d-34bf-4a8a-846e-6089eadd7d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:34:57.526077 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1279/2562] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:34:57.551497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531da1d-d05f-4c42-9676-e0a5ce4c70f7 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:34:57.562451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531da1d-d05f-4c42-9676-e0a5ce4c70f7 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:34:57.568489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830bca8-5b69-41db-9c1c-b2d815ade890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:34:57.569072 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830bca8-5b69-41db-9c1c-b2d815ade890 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:34:57.569349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830bca8-5b69-41db-9c1c-b2d815ade890 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:34:57.569620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830bca8-5b69-41db-9c1c-b2d815ade890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:34:57.577495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830bca8-5b69-41db-9c1c-b2d815ade890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:34:57.579044 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830bca8-5b69-41db-9c1c-b2d815ade890 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:34:57.588362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1284/2563] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:35:00.999743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591b61f-d8df-4204-8831-89fc1fe413f5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:00.999743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591b61f-d8df-4204-8831-89fc1fe413f5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:00.999743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591b61f-d8df-4204-8831-89fc1fe413f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:00.999743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6591b61f-d8df-4204-8831-89fc1fe413f5 None None] MFA Rules not processed for user `8bd18df842724159869f630f96229758`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:35:00.999743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6591b61f-d8df-4204-8831-89fc1fe413f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:01.049778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1280/2564] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:35:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:35:01.756727 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219476c1-fa15-402b-b653-6314c473fb2e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:01.757203 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219476c1-fa15-402b-b653-6314c473fb2e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:01.757297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219476c1-fa15-402b-b653-6314c473fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:01.777481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-219476c1-fa15-402b-b653-6314c473fb2e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:35:01.778695 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-219476c1-fa15-402b-b653-6314c473fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:01.786726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1285/2565] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:35:01.815128 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591b61f-d8df-4204-8831-89fc1fe413f5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:35:01.816634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6591b61f-d8df-4204-8831-89fc1fe413f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:01.833141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591b61f-d8df-4204-8831-89fc1fe413f5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:35:01.838598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffb5fe-e84a-4af2-9f68-e3d23ad1a6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:35:01.839209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffb5fe-e84a-4af2-9f68-e3d23ad1a6af service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:01.839483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffb5fe-e84a-4af2-9f68-e3d23ad1a6af service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:01.839751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffb5fe-e84a-4af2-9f68-e3d23ad1a6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:01.848281 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffb5fe-e84a-4af2-9f68-e3d23ad1a6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:35:01.849863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffb5fe-e84a-4af2-9f68-e3d23ad1a6af service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:35:01.859187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1281/2566] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:35:07.037893 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaaf12-0871-4400-9ba2-a72b92536de8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:07.038438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaaf12-0871-4400-9ba2-a72b92536de8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:07.038438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaaf12-0871-4400-9ba2-a72b92536de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:07.058026 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-cedaaf12-0871-4400-9ba2-a72b92536de8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:35:07.059216 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cedaaf12-0871-4400-9ba2-a72b92536de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:07.066954 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1286/2567] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:35:07.089177 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffb5fe-e84a-4af2-9f68-e3d23ad1a6af service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:35:07.100908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffb5fe-e84a-4af2-9f68-e3d23ad1a6af service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:35:07.106387 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34713d-227e-4d05-a547-5421a153712c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:35:07.106984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34713d-227e-4d05-a547-5421a153712c service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:07.107378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34713d-227e-4d05-a547-5421a153712c service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:07.107649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34713d-227e-4d05-a547-5421a153712c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:07.116715 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34713d-227e-4d05-a547-5421a153712c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:35:07.118330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34713d-227e-4d05-a547-5421a153712c service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:35:07.128482 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1282/2568] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:35:17.052732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=58 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:17.123863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=73 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:18.247127 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaaf12-0871-4400-9ba2-a72b92536de8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:35:18.248692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cedaaf12-0871-4400-9ba2-a72b92536de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:18.318510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaaf12-0871-4400-9ba2-a72b92536de8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:35:18.323722 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f02982-3cc6-4abd-9229-e11ee6053e75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:35:18.324406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f02982-3cc6-4abd-9229-e11ee6053e75 service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:18.324682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f02982-3cc6-4abd-9229-e11ee6053e75 service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:18.324948 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f02982-3cc6-4abd-9229-e11ee6053e75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:18.326629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-28f02982-3cc6-4abd-9229-e11ee6053e75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:18.338430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f02982-3cc6-4abd-9229-e11ee6053e75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:35:18.340038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f02982-3cc6-4abd-9229-e11ee6053e75 service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:35:18.350859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1287/2569] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:35:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:35:24.165032 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f8949-eceb-4c1d-a036-11dec5b6a0e4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:24.165524 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f8949-eceb-4c1d-a036-11dec5b6a0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:24.165629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f8949-eceb-4c1d-a036-11dec5b6a0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:24.184727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-835f8949-eceb-4c1d-a036-11dec5b6a0e4 None None] MFA Rules not processed for user `15d952b7834e4bda878b120e6b176b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:35:24.185907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-835f8949-eceb-4c1d-a036-11dec5b6a0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:24.239236 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1283/2570] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:35:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:35:28.345906 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=32 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:34.232251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=25 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:40.213340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad036b9-e1cb-4b57-acc9-8f2fe92d2cc9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:40.213928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad036b9-e1cb-4b57-acc9-8f2fe92d2cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:40.213928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad036b9-e1cb-4b57-acc9-8f2fe92d2cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:40.233340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-dad036b9-e1cb-4b57-acc9-8f2fe92d2cc9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:35:40.234526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dad036b9-e1cb-4b57-acc9-8f2fe92d2cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:40.242821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1288/2571] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:35:40.264324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f8949-eceb-4c1d-a036-11dec5b6a0e4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:35:40.277097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f8949-eceb-4c1d-a036-11dec5b6a0e4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:35:40.282674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73958ecc-67fd-4b7f-a550-f00161b65d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:35:40.283274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73958ecc-67fd-4b7f-a550-f00161b65d1b service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:40.283551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73958ecc-67fd-4b7f-a550-f00161b65d1b service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:40.283825 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73958ecc-67fd-4b7f-a550-f00161b65d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:40.291850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73958ecc-67fd-4b7f-a550-f00161b65d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:35:40.293460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73958ecc-67fd-4b7f-a550-f00161b65d1b service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:35:40.303214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1284/2572] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:35:45.778080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43589f-3527-4e92-a66d-2cd7c2910913 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:45.778647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43589f-3527-4e92-a66d-2cd7c2910913 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:45.778647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43589f-3527-4e92-a66d-2cd7c2910913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:45.800275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bc43589f-3527-4e92-a66d-2cd7c2910913 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:35:45.801898 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bc43589f-3527-4e92-a66d-2cd7c2910913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:45.813484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1289/2573] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:35:45.840214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73958ecc-67fd-4b7f-a550-f00161b65d1b service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:35:45.852461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73958ecc-67fd-4b7f-a550-f00161b65d1b service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:35:45.858137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc64010-8b4d-45e5-879f-a91e9da2a429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:35:45.858739 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc64010-8b4d-45e5-879f-a91e9da2a429 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:45.859048 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc64010-8b4d-45e5-879f-a91e9da2a429 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:45.859319 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc64010-8b4d-45e5-879f-a91e9da2a429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:45.869260 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc64010-8b4d-45e5-879f-a91e9da2a429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:35:45.877740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc64010-8b4d-45e5-879f-a91e9da2a429 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:35:45.881463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1285/2574] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:35:52.800642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fae63-3f5e-4b50-900e-3f57a4f20b3a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:52.801130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fae63-3f5e-4b50-900e-3f57a4f20b3a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:52.801380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fae63-3f5e-4b50-900e-3f57a4f20b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:52.821826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-144fae63-3f5e-4b50-900e-3f57a4f20b3a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:35:52.823247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-144fae63-3f5e-4b50-900e-3f57a4f20b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:52.832235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1290/2575] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:35:52.853905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc64010-8b4d-45e5-879f-a91e9da2a429 service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:35:52.866043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc64010-8b4d-45e5-879f-a91e9da2a429 service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:35:52.872627 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f79f1-794a-4805-a232-b850d9a81ceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:35:52.882649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f79f1-794a-4805-a232-b850d9a81ceb service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:52.883037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f79f1-794a-4805-a232-b850d9a81ceb service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:52.883454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f79f1-794a-4805-a232-b850d9a81ceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:52.895014 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f79f1-794a-4805-a232-b850d9a81ceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:35:52.898141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f79f1-794a-4805-a232-b850d9a81ceb service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:35:52.909685 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1286/2576] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:35:56.098279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1402a-6729-4dd0-8323-508e6c03e0be None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:56.098821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1402a-6729-4dd0-8323-508e6c03e0be None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:56.098821 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1402a-6729-4dd0-8323-508e6c03e0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:56.118497 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-41e1402a-6729-4dd0-8323-508e6c03e0be None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:35:56.119698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-41e1402a-6729-4dd0-8323-508e6c03e0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:56.127818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1291/2577] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:35:56.167617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f79f1-794a-4805-a232-b850d9a81ceb service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:35:56.179907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f79f1-794a-4805-a232-b850d9a81ceb service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:35:56.191364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54470a-ffdb-48cf-ac71-2308b9907aad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:35:56.192095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54470a-ffdb-48cf-ac71-2308b9907aad service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:56.192445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54470a-ffdb-48cf-ac71-2308b9907aad service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:56.192786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54470a-ffdb-48cf-ac71-2308b9907aad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:56.203030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54470a-ffdb-48cf-ac71-2308b9907aad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:35:56.204819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54470a-ffdb-48cf-ac71-2308b9907aad service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:35:56.215491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1287/2578] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:35:56.438185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd0f7-83c7-474a-ab6a-2c6bfe117c24 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:56.438476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd0f7-83c7-474a-ab6a-2c6bfe117c24 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:56.438815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd0f7-83c7-474a-ab6a-2c6bfe117c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:56.459381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-be6cd0f7-83c7-474a-ab6a-2c6bfe117c24 None None] MFA Rules not processed for user `702b8f59f5d348acb1263f058aed84a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:35:56.460671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-be6cd0f7-83c7-474a-ab6a-2c6bfe117c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:56.519098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1292/2579] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:35:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:35:59.259925 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc559a-a5e0-4c01-b976-8efcac89b807 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:59.260403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc559a-a5e0-4c01-b976-8efcac89b807 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:59.260499 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc559a-a5e0-4c01-b976-8efcac89b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:59.282155 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6ccc559a-a5e0-4c01-b976-8efcac89b807 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:35:59.283416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6ccc559a-a5e0-4c01-b976-8efcac89b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:35:59.293165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1288/2580] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Sep 2 09:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:35:59.342808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd0f7-83c7-474a-ab6a-2c6bfe117c24 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:35:59.355452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd0f7-83c7-474a-ab6a-2c6bfe117c24 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:35:59.360885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c8790-f622-4b35-931c-22f52bbc6cff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:35:59.361479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c8790-f622-4b35-931c-22f52bbc6cff service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:35:59.361760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c8790-f622-4b35-931c-22f52bbc6cff service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:35:59.362029 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c8790-f622-4b35-931c-22f52bbc6cff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:35:59.370166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c8790-f622-4b35-931c-22f52bbc6cff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:35:59.371817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c8790-f622-4b35-931c-22f52bbc6cff service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:35:59.382002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1293/2581] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:09.276593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=27 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:09.377302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=43 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:24.271337 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc559a-a5e0-4c01-b976-8efcac89b807 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:24.272798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6ccc559a-a5e0-4c01-b976-8efcac89b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:24.286045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc559a-a5e0-4c01-b976-8efcac89b807 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:24.290852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:24.291494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:24.291773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:24.292115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] PATH_INFO: `/v3/users/8bd18df842724159869f630f96229758` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:24.293300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd18df842724159869f630f96229758)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:24.295324 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:24.494498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd18df842724159869f630f96229758'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:24.495100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd18df842724159869f630f96229758'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:24.507934 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd18df842724159869f630f96229758'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:24.514745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd18df842724159869f630f96229758'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:24.583952 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd18df842724159869f630f96229758'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:24.590182 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1289/2582] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:36:24 2022] DELETE /identity/v3/users/8bd18df842724159869f630f96229758 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:36:24.600009 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c8790-f622-4b35-931c-22f52bbc6cff service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:24.601505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d97c8790-f622-4b35-931c-22f52bbc6cff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:24.658106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c8790-f622-4b35-931c-22f52bbc6cff service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:24.708825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47844d0-2caa-4b7c-8674-227852b22183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:24.714815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47844d0-2caa-4b7c-8674-227852b22183 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:24.714815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47844d0-2caa-4b7c-8674-227852b22183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:24.714815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47844d0-2caa-4b7c-8674-227852b22183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:24.714815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e47844d0-2caa-4b7c-8674-227852b22183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:24.783344 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47844d0-2caa-4b7c-8674-227852b22183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:24.784815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47844d0-2caa-4b7c-8674-227852b22183 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:24.795172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1294/2583] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:25.044580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:25.046006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:25.060491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbc485-91c2-49b2-8503-814e408abe81 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:25.065815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:25.066451 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:25.066729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:25.067009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] PATH_INFO: `/v3/projects/07e98d12a75249e7ae05d6e9cdc5bdd7` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:25.068170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e98d12a75249e7ae05d6e9cdc5bdd7)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:25.070104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:25.202029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e98d12a75249e7ae05d6e9cdc5bdd7', 'request_id': 'req-9a8839eb-a18c-4517-86db-9574141f885c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:25.207752 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e98d12a75249e7ae05d6e9cdc5bdd7', 'request_id': 'req-9a8839eb-a18c-4517-86db-9574141f885c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:25.214601 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e98d12a75249e7ae05d6e9cdc5bdd7', 'request_id': 'req-9a8839eb-a18c-4517-86db-9574141f885c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:25.309619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] The token cache is being invalidate because project 07e98d12a75249e7ae05d6e9cdc5bdd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:36:25.310321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:25.310579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9a8839eb-a18c-4517-86db-9574141f885c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:25.312091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1290/2584] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:36:25 2022] DELETE /identity/v3/projects/07e98d12a75249e7ae05d6e9cdc5bdd7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:36:25.318043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250b6f1-ebc9-435f-82e2-ca968de97716 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:25.318329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250b6f1-ebc9-435f-82e2-ca968de97716 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:25.318601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250b6f1-ebc9-435f-82e2-ca968de97716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:25.338544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d250b6f1-ebc9-435f-82e2-ca968de97716 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:25.343618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d250b6f1-ebc9-435f-82e2-ca968de97716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:25.404130 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1295/2585] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:36:25.411861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffbd3-6920-4a1c-a70d-f72c50a341ee None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:25.412185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffbd3-6920-4a1c-a70d-f72c50a341ee None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:25.412463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffbd3-6920-4a1c-a70d-f72c50a341ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:25.432590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-68bffbd3-6920-4a1c-a70d-f72c50a341ee None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:25.433785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-68bffbd3-6920-4a1c-a70d-f72c50a341ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:25.441639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1291/2586] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:36:25.445754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250b6f1-ebc9-435f-82e2-ca968de97716 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:25.455392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250b6f1-ebc9-435f-82e2-ca968de97716 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:25.460129 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27974c-221f-4370-a111-3e2a1caab09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:25.461234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27974c-221f-4370-a111-3e2a1caab09a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:25.461509 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27974c-221f-4370-a111-3e2a1caab09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:25.461777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27974c-221f-4370-a111-3e2a1caab09a admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:25.462410 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27974c-221f-4370-a111-3e2a1caab09a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:36:25.462708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27974c-221f-4370-a111-3e2a1caab09a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:25.464437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27974c-221f-4370-a111-3e2a1caab09a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:25.465866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:25.476967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1296/2587] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:36:25.481350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bffbd3-6920-4a1c-a70d-f72c50a341ee None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:25.490971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bffbd3-6920-4a1c-a70d-f72c50a341ee None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:25.495776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074b3e5-26e9-47ec-8ecc-33f968111a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:25.496409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074b3e5-26e9-47ec-8ecc-33f968111a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:25.496689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074b3e5-26e9-47ec-8ecc-33f968111a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:25.496977 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074b3e5-26e9-47ec-8ecc-33f968111a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:25.497586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074b3e5-26e9-47ec-8ecc-33f968111a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:25.499778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074b3e5-26e9-47ec-8ecc-33f968111a12 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:25.575762 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1292/2588] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:36:25 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:36:25.580402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27974c-221f-4370-a111-3e2a1caab09a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:25.591456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27974c-221f-4370-a111-3e2a1caab09a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:25.645916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07152aed-652a-4795-927a-343c7a461fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:25.646552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07152aed-652a-4795-927a-343c7a461fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:25.646781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07152aed-652a-4795-927a-343c7a461fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:25.647077 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07152aed-652a-4795-927a-343c7a461fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:25.647709 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07152aed-652a-4795-927a-343c7a461fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:25.650264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07152aed-652a-4795-927a-343c7a461fb1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:25.727809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1297/2589] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:36:25 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:36:25.732064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074b3e5-26e9-47ec-8ecc-33f968111a12 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:25.742835 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074b3e5-26e9-47ec-8ecc-33f968111a12 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:25.747708 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede63a63-62be-46be-8554-0d9197064eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:25.748388 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63a63-62be-46be-8554-0d9197064eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:25.748911 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63a63-62be-46be-8554-0d9197064eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:25.749778 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63a63-62be-46be-8554-0d9197064eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:25.750009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede63a63-62be-46be-8554-0d9197064eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:25.751467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede63a63-62be-46be-8554-0d9197064eb9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:25.762491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1293/2590] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:36:25.766662 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07152aed-652a-4795-927a-343c7a461fb1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:25.777300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07152aed-652a-4795-927a-343c7a461fb1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:25.782068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94872f-5548-4aa5-b700-976ee7a4ef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:25.782663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94872f-5548-4aa5-b700-976ee7a4ef86 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:25.782991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94872f-5548-4aa5-b700-976ee7a4ef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:25.783214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94872f-5548-4aa5-b700-976ee7a4ef86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:25.783923 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94872f-5548-4aa5-b700-976ee7a4ef86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:25.785505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94872f-5548-4aa5-b700-976ee7a4ef86 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:25.795849 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1298/2591] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:36:25.800079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede63a63-62be-46be-8554-0d9197064eb9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:25.810099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede63a63-62be-46be-8554-0d9197064eb9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:25.814749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c8715-8641-404f-9631-f8890bb2eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:25.815424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c8715-8641-404f-9631-f8890bb2eafd admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:25.815705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c8715-8641-404f-9631-f8890bb2eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:25.816019 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c8715-8641-404f-9631-f8890bb2eafd admin admin] PATH_INFO: `/v3/projects/282a3d9e81b447b4b60de8158bce71f3/users/8cef640d90d04f26b0f4abbb7ab33a4f/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:25.828587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:25.831580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c8715-8641-404f-9631-f8890bb2eafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=282a3d9e81b447b4b60de8158bce71f3, user_id=8cef640d90d04f26b0f4abbb7ab33a4f, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:25.834298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c8715-8641-404f-9631-f8890bb2eafd admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:25.910781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1294/2592] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:36:25 2022] PUT /identity/v3/projects/282a3d9e81b447b4b60de8158bce71f3/users/8cef640d90d04f26b0f4abbb7ab33a4f/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:36:25.915867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399adcdb-da00-4c40-ae6d-4b24a3f19725 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:25.916308 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399adcdb-da00-4c40-ae6d-4b24a3f19725 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:25.916597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399adcdb-da00-4c40-ae6d-4b24a3f19725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:25.935639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-399adcdb-da00-4c40-ae6d-4b24a3f19725 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:25.939083 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-399adcdb-da00-4c40-ae6d-4b24a3f19725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:25.995716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1299/2593] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:36:26.005594 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c8715-8641-404f-9631-f8890bb2eafd admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:26.007947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-df6c8715-8641-404f-9631-f8890bb2eafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:26.065318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c8715-8641-404f-9631-f8890bb2eafd admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:26.068933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0e9cc-d73e-456a-985b-ab8701f8f149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:26.069513 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0e9cc-d73e-456a-985b-ab8701f8f149 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:26.070403 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0e9cc-d73e-456a-985b-ab8701f8f149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:26.070689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0e9cc-d73e-456a-985b-ab8701f8f149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:26.079909 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0e9cc-d73e-456a-985b-ab8701f8f149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:26.081346 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0e9cc-d73e-456a-985b-ab8701f8f149 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:26.090836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1295/2594] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:26.336781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399adcdb-da00-4c40-ae6d-4b24a3f19725 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:26.338198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-399adcdb-da00-4c40-ae6d-4b24a3f19725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:26.350913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399adcdb-da00-4c40-ae6d-4b24a3f19725 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:26.355910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb2b84-0d4c-47bf-8581-66747ecaa11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:26.355910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb2b84-0d4c-47bf-8581-66747ecaa11d service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:26.356167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb2b84-0d4c-47bf-8581-66747ecaa11d service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:26.356580 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb2b84-0d4c-47bf-8581-66747ecaa11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:26.358717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-13bb2b84-0d4c-47bf-8581-66747ecaa11d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:26.450109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb2b84-0d4c-47bf-8581-66747ecaa11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:26.451544 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb2b84-0d4c-47bf-8581-66747ecaa11d service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:26.456871 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:26.463980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1300/2595] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:27.805729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0e9cc-d73e-456a-985b-ab8701f8f149 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:27.815711 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0e9cc-d73e-456a-985b-ab8701f8f149 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:27.824672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384edec-5d37-4dc0-8d2a-dfa8235f019e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:27.825528 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384edec-5d37-4dc0-8d2a-dfa8235f019e service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:27.826001 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384edec-5d37-4dc0-8d2a-dfa8235f019e service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:27.826452 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384edec-5d37-4dc0-8d2a-dfa8235f019e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:27.828590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6384edec-5d37-4dc0-8d2a-dfa8235f019e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:27.850005 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384edec-5d37-4dc0-8d2a-dfa8235f019e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:27.851638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384edec-5d37-4dc0-8d2a-dfa8235f019e service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:27.863821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1296/2596] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:31.014326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad23d-5589-4501-acf1-96320b11e2b0 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:31.015667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad23d-5589-4501-acf1-96320b11e2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:31.016756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad23d-5589-4501-acf1-96320b11e2b0 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:31.018498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1301/2597] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:36:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:36:31.024658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174381d-2619-4cd2-81d4-51c8669f1668 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:31.025502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174381d-2619-4cd2-81d4-51c8669f1668 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:31.025941 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174381d-2619-4cd2-81d4-51c8669f1668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:31.052480 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5174381d-2619-4cd2-81d4-51c8669f1668 None None] MFA Rules not processed for user `81bb83de9f794ac9b02e5dca2df3e4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:31.055532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5174381d-2619-4cd2-81d4-51c8669f1668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:31.070040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1297/2598] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:36:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:36:31.078668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ad23d-5589-4501-acf1-96320b11e2b0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:31.113776 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ad23d-5589-4501-acf1-96320b11e2b0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:31.118284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056345b-3c8b-404e-a31b-9015a92712d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:31.118897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056345b-3c8b-404e-a31b-9015a92712d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:31.119212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056345b-3c8b-404e-a31b-9015a92712d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:31.119485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056345b-3c8b-404e-a31b-9015a92712d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:31.133902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056345b-3c8b-404e-a31b-9015a92712d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:31.136169 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056345b-3c8b-404e-a31b-9015a92712d0 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:31.151482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1302/2599] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:31.257616 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85c3e-72a0-4cb5-adcf-74bca4015609 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:31.258321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85c3e-72a0-4cb5-adcf-74bca4015609 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:31.258690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85c3e-72a0-4cb5-adcf-74bca4015609 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:31.260970 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1298/2600] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:36:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:36:31.266079 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe9144-7151-48a0-8324-dedfd9ee37e6 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:31.266362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe9144-7151-48a0-8324-dedfd9ee37e6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:31.266658 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe9144-7151-48a0-8324-dedfd9ee37e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:31.290047 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0afe9144-7151-48a0-8324-dedfd9ee37e6 None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:31.291447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0afe9144-7151-48a0-8324-dedfd9ee37e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:31.301375 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1303/2601] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:36:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:36:31.321471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a85c3e-72a0-4cb5-adcf-74bca4015609 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:31.338212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a85c3e-72a0-4cb5-adcf-74bca4015609 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:31.345606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b16b3-7ae0-478e-b1b8-cefe805d200f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:31.346239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b16b3-7ae0-478e-b1b8-cefe805d200f service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:31.346521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b16b3-7ae0-478e-b1b8-cefe805d200f service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:31.346797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b16b3-7ae0-478e-b1b8-cefe805d200f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:31.361638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b16b3-7ae0-478e-b1b8-cefe805d200f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:31.363254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b16b3-7ae0-478e-b1b8-cefe805d200f service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:31.385946 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1299/2602] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:31.688456 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6480a2d-8d92-4c0a-9a12-dbcd36a7b33b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:31.689000 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6480a2d-8d92-4c0a-9a12-dbcd36a7b33b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:31.689447 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6480a2d-8d92-4c0a-9a12-dbcd36a7b33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:31.737092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b6480a2d-8d92-4c0a-9a12-dbcd36a7b33b None None] MFA Rules not processed for user `8cef640d90d04f26b0f4abbb7ab33a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:31.738840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b6480a2d-8d92-4c0a-9a12-dbcd36a7b33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:31.891482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1304/2603] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:36:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:36:31.913037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b16b3-7ae0-478e-b1b8-cefe805d200f service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:31.915948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f19b16b3-7ae0-478e-b1b8-cefe805d200f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:31.940398 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b16b3-7ae0-478e-b1b8-cefe805d200f service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:31.946653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeadcb-d07f-4003-8d91-4932a5e66bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:31.947287 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeadcb-d07f-4003-8d91-4932a5e66bca service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:31.947567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeadcb-d07f-4003-8d91-4932a5e66bca service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:31.947840 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeadcb-d07f-4003-8d91-4932a5e66bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:31.956867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeadcb-d07f-4003-8d91-4932a5e66bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:31.958712 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeadcb-d07f-4003-8d91-4932a5e66bca service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:31.970291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1300/2604] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:34.878248 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91573aa4-956b-4152-a348-971488a269e1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:34.878673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91573aa4-956b-4152-a348-971488a269e1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:34.878865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91573aa4-956b-4152-a348-971488a269e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:34.906059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-91573aa4-956b-4152-a348-971488a269e1 None None] MFA Rules not processed for user `8cef640d90d04f26b0f4abbb7ab33a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:34.914828 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-91573aa4-956b-4152-a348-971488a269e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:34.923024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1305/2605] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:36:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:36:41.265420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeadcb-d07f-4003-8d91-4932a5e66bca service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:41.268883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-36eeadcb-d07f-4003-8d91-4932a5e66bca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:41.341040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeadcb-d07f-4003-8d91-4932a5e66bca service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:41.346114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da2f5b-5574-4c8c-a784-26fcb584e757 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:41.346721 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da2f5b-5574-4c8c-a784-26fcb584e757 service placement] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:41.346997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da2f5b-5574-4c8c-a784-26fcb584e757 service placement] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:41.347268 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da2f5b-5574-4c8c-a784-26fcb584e757 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:41.349030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e0da2f5b-5574-4c8c-a784-26fcb584e757 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:41.360401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da2f5b-5574-4c8c-a784-26fcb584e757 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:41.362115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da2f5b-5574-4c8c-a784-26fcb584e757 service placement] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:41.372197 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1301/2606] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:41.420330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91573aa4-956b-4152-a348-971488a269e1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:41.421733 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-91573aa4-956b-4152-a348-971488a269e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:41.436771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91573aa4-956b-4152-a348-971488a269e1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:41.441389 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:41.442006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:41.442277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:41.442542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] PATH_INFO: `/v3/users/15d952b7834e4bda878b120e6b176b2c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:41.443632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d952b7834e4bda878b120e6b176b2c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:41.445648 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:41.617087 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d952b7834e4bda878b120e6b176b2c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:41.682527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d952b7834e4bda878b120e6b176b2c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:41.690280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d952b7834e4bda878b120e6b176b2c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:41.690927 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d952b7834e4bda878b120e6b176b2c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:41.704869 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ab905bdf-f6a3-43de-91eb-b4cf39a1fafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d952b7834e4bda878b120e6b176b2c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:41.711145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1306/2607] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:36:41 2022] DELETE /identity/v3/users/15d952b7834e4bda878b120e6b176b2c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:36:41.947634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da2f5b-5574-4c8c-a784-26fcb584e757 service placement] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:41.962814 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da2f5b-5574-4c8c-a784-26fcb584e757 service placement] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:41.996453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:42.019642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:42.020341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:42.020619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:42.020895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] PATH_INFO: `/v3/projects/68a117d902b642a6aee8248ede5b5fd4` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:42.022010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a117d902b642a6aee8248ede5b5fd4)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:42.023979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:42.164124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a117d902b642a6aee8248ede5b5fd4', 'request_id': 'req-85f24bc4-2561-450d-9007-56f89bdbb912'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:42.170098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a117d902b642a6aee8248ede5b5fd4', 'request_id': 'req-85f24bc4-2561-450d-9007-56f89bdbb912'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:42.177636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a117d902b642a6aee8248ede5b5fd4', 'request_id': 'req-85f24bc4-2561-450d-9007-56f89bdbb912'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:42.275855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] The token cache is being invalidate because project 68a117d902b642a6aee8248ede5b5fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:36:42.276534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:42.276894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-85f24bc4-2561-450d-9007-56f89bdbb912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:36:42.278393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1302/2608] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:36:41 2022] DELETE /identity/v3/projects/68a117d902b642a6aee8248ede5b5fd4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:36:42.283991 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81fec-85c5-435c-ac79-8ecd56f352d3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:42.284346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81fec-85c5-435c-ac79-8ecd56f352d3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:42.284684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81fec-85c5-435c-ac79-8ecd56f352d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:42.304301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-09e81fec-85c5-435c-ac79-8ecd56f352d3 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:42.305503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-09e81fec-85c5-435c-ac79-8ecd56f352d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:42.343217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:42.399716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1307/2609] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:36:42.413697 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9fda-7740-417b-a1e6-2b0091f33cfe None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:42.413978 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9fda-7740-417b-a1e6-2b0091f33cfe None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:42.414250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9fda-7740-417b-a1e6-2b0091f33cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:42.444279 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-23dd9fda-7740-417b-a1e6-2b0091f33cfe None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:42.445501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-23dd9fda-7740-417b-a1e6-2b0091f33cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:42.458054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1303/2610] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:36:42.459260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81fec-85c5-435c-ac79-8ecd56f352d3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:42.470747 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81fec-85c5-435c-ac79-8ecd56f352d3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:42.475457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437377-be09-4e24-9096-f7cac223ca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:42.476140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437377-be09-4e24-9096-f7cac223ca3a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:42.476733 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437377-be09-4e24-9096-f7cac223ca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:42.477081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437377-be09-4e24-9096-f7cac223ca3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:42.478059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08437377-be09-4e24-9096-f7cac223ca3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:36:42.478642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08437377-be09-4e24-9096-f7cac223ca3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:42.480364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08437377-be09-4e24-9096-f7cac223ca3a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:42.494226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1308/2611] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:36:42.498478 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9fda-7740-417b-a1e6-2b0091f33cfe None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:42.509660 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9fda-7740-417b-a1e6-2b0091f33cfe None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:42.514382 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c083f8-34e1-4fd8-aa6d-5c5a7ee4ac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:42.514984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c083f8-34e1-4fd8-aa6d-5c5a7ee4ac4d admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:42.515262 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c083f8-34e1-4fd8-aa6d-5c5a7ee4ac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:42.515533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c083f8-34e1-4fd8-aa6d-5c5a7ee4ac4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:42.516208 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c083f8-34e1-4fd8-aa6d-5c5a7ee4ac4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:42.518118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c083f8-34e1-4fd8-aa6d-5c5a7ee4ac4d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:42.648248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1304/2612] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:36:42 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:36:42.652606 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437377-be09-4e24-9096-f7cac223ca3a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:42.662317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437377-be09-4e24-9096-f7cac223ca3a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:42.717920 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142767cc-5a3d-421f-84ab-40b766a28698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:42.718501 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142767cc-5a3d-421f-84ab-40b766a28698 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:42.718773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142767cc-5a3d-421f-84ab-40b766a28698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:42.719039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142767cc-5a3d-421f-84ab-40b766a28698 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:42.719681 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142767cc-5a3d-421f-84ab-40b766a28698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:42.721590 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142767cc-5a3d-421f-84ab-40b766a28698 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:42.801822 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1309/2613] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:36:42 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:36:42.806598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c083f8-34e1-4fd8-aa6d-5c5a7ee4ac4d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:42.816849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c083f8-34e1-4fd8-aa6d-5c5a7ee4ac4d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:42.821442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd50c-c0f2-4d6e-82ab-3f84fb78d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:42.822031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd50c-c0f2-4d6e-82ab-3f84fb78d652 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:42.822304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd50c-c0f2-4d6e-82ab-3f84fb78d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:42.822651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd50c-c0f2-4d6e-82ab-3f84fb78d652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:42.823216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fd50c-c0f2-4d6e-82ab-3f84fb78d652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:42.824987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fd50c-c0f2-4d6e-82ab-3f84fb78d652 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:42.835563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1305/2614] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:36:42.839390 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142767cc-5a3d-421f-84ab-40b766a28698 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:42.849427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142767cc-5a3d-421f-84ab-40b766a28698 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:42.854578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c06162-71a8-4fa3-b024-8973f5552062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:42.855172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c06162-71a8-4fa3-b024-8973f5552062 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:42.855452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c06162-71a8-4fa3-b024-8973f5552062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:42.855723 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c06162-71a8-4fa3-b024-8973f5552062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:42.856388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c06162-71a8-4fa3-b024-8973f5552062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:42.857963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c06162-71a8-4fa3-b024-8973f5552062 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:42.868986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1310/2615] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:36:42.873136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd50c-c0f2-4d6e-82ab-3f84fb78d652 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:42.883098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd50c-c0f2-4d6e-82ab-3f84fb78d652 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:42.888003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a9722-07b7-4539-a817-54c2824e3fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:42.888638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a9722-07b7-4539-a817-54c2824e3fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:42.888913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a9722-07b7-4539-a817-54c2824e3fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:42.889185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a9722-07b7-4539-a817-54c2824e3fdd admin admin] PATH_INFO: `/v3/projects/ceb63d9cde63407e8bef35a2e20630f3/users/4f9d9e41a62a40c58a8dfa463337bd59/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:42.903336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a9722-07b7-4539-a817-54c2824e3fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb63d9cde63407e8bef35a2e20630f3, user_id=4f9d9e41a62a40c58a8dfa463337bd59, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:42.905933 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a9722-07b7-4539-a817-54c2824e3fdd admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:42.975651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1306/2616] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:36:42 2022] PUT /identity/v3/projects/ceb63d9cde63407e8bef35a2e20630f3/users/4f9d9e41a62a40c58a8dfa463337bd59/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:36:42.981675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a673-94fd-4c00-afdb-d7761f179d03 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:42.982022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a673-94fd-4c00-afdb-d7761f179d03 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:42.982319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a673-94fd-4c00-afdb-d7761f179d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:43.002418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4611a673-94fd-4c00-afdb-d7761f179d03 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:43.003624 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4611a673-94fd-4c00-afdb-d7761f179d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:43.062484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1311/2617] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:36:43.072050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a9722-07b7-4539-a817-54c2824e3fdd admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:43.073795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-860a9722-07b7-4539-a817-54c2824e3fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:43.136710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a9722-07b7-4539-a817-54c2824e3fdd admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:43.140496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad21a5-5b3f-44ba-a50e-6720f4e6a489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:43.141136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad21a5-5b3f-44ba-a50e-6720f4e6a489 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:43.141582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad21a5-5b3f-44ba-a50e-6720f4e6a489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:43.141847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad21a5-5b3f-44ba-a50e-6720f4e6a489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:43.151899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad21a5-5b3f-44ba-a50e-6720f4e6a489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:43.153327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad21a5-5b3f-44ba-a50e-6720f4e6a489 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:43.163060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1307/2618] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:48.859490 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d81f17-662d-402b-8fe6-e9235536edbd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:48.860035 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d81f17-662d-402b-8fe6-e9235536edbd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:48.860138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d81f17-662d-402b-8fe6-e9235536edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:48.893230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-20d81f17-662d-402b-8fe6-e9235536edbd None None] MFA Rules not processed for user `4f9d9e41a62a40c58a8dfa463337bd59`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:48.894412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-20d81f17-662d-402b-8fe6-e9235536edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:48.929011 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:48.968131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1312/2619] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:36:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:36:48.973008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad21a5-5b3f-44ba-a50e-6720f4e6a489 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:48.983758 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad21a5-5b3f-44ba-a50e-6720f4e6a489 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:48.988642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d47710-6484-401d-afa6-992c76062be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:48.989246 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47710-6484-401d-afa6-992c76062be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:48.989527 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47710-6484-401d-afa6-992c76062be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:48.990000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47710-6484-401d-afa6-992c76062be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:48.990645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d47710-6484-401d-afa6-992c76062be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:48.992702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d47710-6484-401d-afa6-992c76062be5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:48.997348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:49.099205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1308/2620] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:36:48 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:36:49.100710 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d81f17-662d-402b-8fe6-e9235536edbd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:49.111666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d81f17-662d-402b-8fe6-e9235536edbd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:49.169706 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0f651-1ce7-4627-8f4a-bf1f57bd0801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:49.170322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0f651-1ce7-4627-8f4a-bf1f57bd0801 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:49.170622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0f651-1ce7-4627-8f4a-bf1f57bd0801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:49.170893 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0f651-1ce7-4627-8f4a-bf1f57bd0801 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:49.171585 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0f651-1ce7-4627-8f4a-bf1f57bd0801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:49.173663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0f651-1ce7-4627-8f4a-bf1f57bd0801 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:49.270089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1313/2621] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:36:49 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:36:49.274058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d47710-6484-401d-afa6-992c76062be5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:49.284519 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d47710-6484-401d-afa6-992c76062be5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:49.289175 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ea337-6157-499b-b843-7b25b041895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:49.289804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ea337-6157-499b-b843-7b25b041895b admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:49.290340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ea337-6157-499b-b843-7b25b041895b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:49.290495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ea337-6157-499b-b843-7b25b041895b admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:49.291011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ea337-6157-499b-b843-7b25b041895b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:49.292634 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ea337-6157-499b-b843-7b25b041895b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:49.302716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1309/2622] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:36:49.307375 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0f651-1ce7-4627-8f4a-bf1f57bd0801 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:49.317661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0f651-1ce7-4627-8f4a-bf1f57bd0801 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:49.323121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd4664-328d-43b0-9007-e7d7cefe1007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:49.323782 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd4664-328d-43b0-9007-e7d7cefe1007 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:49.324089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd4664-328d-43b0-9007-e7d7cefe1007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:49.324366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd4664-328d-43b0-9007-e7d7cefe1007 admin admin] PATH_INFO: `/v3/projects/f2d45732e4ab4d958c73e256d9e54a3e/users/c3889065d1f44f6c87a3a71011908c68/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:49.341632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd4664-328d-43b0-9007-e7d7cefe1007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d45732e4ab4d958c73e256d9e54a3e, user_id=c3889065d1f44f6c87a3a71011908c68, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:49.344365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd4664-328d-43b0-9007-e7d7cefe1007 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:49.425629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1314/2623] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:36:49 2022] PUT /identity/v3/projects/f2d45732e4ab4d958c73e256d9e54a3e/users/c3889065d1f44f6c87a3a71011908c68/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:36:49.429671 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ea337-6157-499b-b843-7b25b041895b admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:49.440587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ea337-6157-499b-b843-7b25b041895b admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:49.500716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e6779-e5a6-44c9-9b14-d3fab40a5764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:49.501360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6779-e5a6-44c9-9b14-d3fab40a5764 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:49.501641 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6779-e5a6-44c9-9b14-d3fab40a5764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:49.501916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6779-e5a6-44c9-9b14-d3fab40a5764 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:49.502587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e6779-e5a6-44c9-9b14-d3fab40a5764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:49.504374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e6779-e5a6-44c9-9b14-d3fab40a5764 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:49.514676 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1310/2624] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:36:49.518891 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd4664-328d-43b0-9007-e7d7cefe1007 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:49.529412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd4664-328d-43b0-9007-e7d7cefe1007 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:49.534249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6fda9-923f-466d-ad8b-bc1eccecf0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:49.534932 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6fda9-923f-466d-ad8b-bc1eccecf0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:49.535208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6fda9-923f-466d-ad8b-bc1eccecf0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:49.535478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6fda9-923f-466d-ad8b-bc1eccecf0d1 admin admin] PATH_INFO: `/v3/projects/f2d45732e4ab4d958c73e256d9e54a3e/users/c3889065d1f44f6c87a3a71011908c68/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:49.537496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6fda9-923f-466d-ad8b-bc1eccecf0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d45732e4ab4d958c73e256d9e54a3e, user_id=c3889065d1f44f6c87a3a71011908c68, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:49.540720 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6fda9-923f-466d-ad8b-bc1eccecf0d1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:49.551425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1315/2625] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:36:49 2022] PUT /identity/v3/projects/f2d45732e4ab4d958c73e256d9e54a3e/users/c3889065d1f44f6c87a3a71011908c68/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:36:55.300605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168759c0-8915-4e08-8138-d31309560f4e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:55.301136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168759c0-8915-4e08-8138-d31309560f4e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:55.301420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168759c0-8915-4e08-8138-d31309560f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:55.333809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-168759c0-8915-4e08-8138-d31309560f4e None None] MFA Rules not processed for user `c3889065d1f44f6c87a3a71011908c68`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:55.334960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-168759c0-8915-4e08-8138-d31309560f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:55.408062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1311/2626] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:36:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:36:55.425476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6fda9-923f-466d-ad8b-bc1eccecf0d1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:55.439734 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0af6fda9-923f-466d-ad8b-bc1eccecf0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:55.509564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6fda9-923f-466d-ad8b-bc1eccecf0d1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:55.513398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bbcf0-ff0e-4805-a343-342c586478e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6267b159204df7af8a4f84d227f88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:55.514025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bbcf0-ff0e-4805-a343-342c586478e4 service glance] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:55.514465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bbcf0-ff0e-4805-a343-342c586478e4 service glance] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:55.514738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bbcf0-ff0e-4805-a343-342c586478e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:55.552021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:55.575540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bbcf0-ff0e-4805-a343-342c586478e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:55.577024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bbcf0-ff0e-4805-a343-342c586478e4 service glance] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:55.587429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1316/2627] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:55.695078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168759c0-8915-4e08-8138-d31309560f4e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:55.697020 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-168759c0-8915-4e08-8138-d31309560f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:55.772630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:55.796490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168759c0-8915-4e08-8138-d31309560f4e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:55.802988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7393cb-2d23-4545-b839-9d7cbd438698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:55.803630 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7393cb-2d23-4545-b839-9d7cbd438698 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:55.803948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7393cb-2d23-4545-b839-9d7cbd438698 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:55.804223 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7393cb-2d23-4545-b839-9d7cbd438698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:55.806161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5b7393cb-2d23-4545-b839-9d7cbd438698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:55.891402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16399-f53f-48dc-8ca6-4d1e5d46bec1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:55.892807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16399-f53f-48dc-8ca6-4d1e5d46bec1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:55.893289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16399-f53f-48dc-8ca6-4d1e5d46bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:55.927096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5ea16399-f53f-48dc-8ca6-4d1e5d46bec1 None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:36:55.928484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5ea16399-f53f-48dc-8ca6-4d1e5d46bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:55.933136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7393cb-2d23-4545-b839-9d7cbd438698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:55.934776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7393cb-2d23-4545-b839-9d7cbd438698 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:55.947822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1312/2628] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:36:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:36:56.024494 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1317/2629] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:36:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:36:56.190636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7393cb-2d23-4545-b839-9d7cbd438698 service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:36:56.192258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5b7393cb-2d23-4545-b839-9d7cbd438698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:36:56.269891 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7393cb-2d23-4545-b839-9d7cbd438698 service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:36:56.275214 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e474e2f-28d2-4e50-8477-f0508e8b43e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:36:56.275995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e474e2f-28d2-4e50-8477-f0508e8b43e7 service swift] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:36:56.276278 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e474e2f-28d2-4e50-8477-f0508e8b43e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:36:56.276552 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e474e2f-28d2-4e50-8477-f0508e8b43e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:36:56.285623 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e474e2f-28d2-4e50-8477-f0508e8b43e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:36:56.287427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e474e2f-28d2-4e50-8477-f0508e8b43e7 service swift] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:36:56.296863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1313/2630] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:37:06.009756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=36 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:06.293781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=63 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:06.726197 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf993da-db9d-4e4c-aea3-896d8018bbe0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:06.736048 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf993da-db9d-4e4c-aea3-896d8018bbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:06.736048 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf993da-db9d-4e4c-aea3-896d8018bbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:06.745455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-eaf993da-db9d-4e4c-aea3-896d8018bbe0 None None] MFA Rules not processed for user `4f9d9e41a62a40c58a8dfa463337bd59`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:37:06.746694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-eaf993da-db9d-4e4c-aea3-896d8018bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:06.754059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1318/2631] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:37:07.007584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e474e2f-28d2-4e50-8477-f0508e8b43e7 service swift] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:07.010017 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2e474e2f-28d2-4e50-8477-f0508e8b43e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:07.068678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e474e2f-28d2-4e50-8477-f0508e8b43e7 service swift] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:07.072748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f7336-8dbe-4c7e-9d46-f8e2165707f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:07.073341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f7336-8dbe-4c7e-9d46-f8e2165707f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:07.073614 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f7336-8dbe-4c7e-9d46-f8e2165707f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:07.073881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f7336-8dbe-4c7e-9d46-f8e2165707f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:07.075592 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7c8f7336-8dbe-4c7e-9d46-f8e2165707f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:07.084955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f7336-8dbe-4c7e-9d46-f8e2165707f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:07.086415 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f7336-8dbe-4c7e-9d46-f8e2165707f0 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:07.096003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1314/2632] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:07.552878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf993da-db9d-4e4c-aea3-896d8018bbe0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:07.554401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-eaf993da-db9d-4e4c-aea3-896d8018bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:07.628114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf993da-db9d-4e4c-aea3-896d8018bbe0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:07.632960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbbc39-bda9-42bb-8dc0-5f1f9fc1a43e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:07.633560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbbc39-bda9-42bb-8dc0-5f1f9fc1a43e service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:07.634331 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbbc39-bda9-42bb-8dc0-5f1f9fc1a43e service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:07.634597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbbc39-bda9-42bb-8dc0-5f1f9fc1a43e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:07.636372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d3fbbc39-bda9-42bb-8dc0-5f1f9fc1a43e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:07.647340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbbc39-bda9-42bb-8dc0-5f1f9fc1a43e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:07.648931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbbc39-bda9-42bb-8dc0-5f1f9fc1a43e service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:07.659195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1319/2633] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:37:11.045289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9fe90-4556-40fc-88a3-ae828530b03f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:11.045753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9fe90-4556-40fc-88a3-ae828530b03f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:11.045849 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9fe90-4556-40fc-88a3-ae828530b03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:11.065901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8ea9fe90-4556-40fc-88a3-ae828530b03f None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:37:11.067102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8ea9fe90-4556-40fc-88a3-ae828530b03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:11.074531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1315/2634] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:37:11.088809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbbc39-bda9-42bb-8dc0-5f1f9fc1a43e service placement] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:11.100562 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbbc39-bda9-42bb-8dc0-5f1f9fc1a43e service placement] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:11.106510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a00146-a4a8-4432-958c-3b1486c0e280 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:11.107167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a00146-a4a8-4432-958c-3b1486c0e280 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:11.107381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a00146-a4a8-4432-958c-3b1486c0e280 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:11.107650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a00146-a4a8-4432-958c-3b1486c0e280 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:11.116703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a00146-a4a8-4432-958c-3b1486c0e280 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:11.118324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a00146-a4a8-4432-958c-3b1486c0e280 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:11.127988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1320/2635] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:37:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:37:20.078702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9fe90-4556-40fc-88a3-ae828530b03f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:20.088437 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9fe90-4556-40fc-88a3-ae828530b03f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:20.092548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264197c7-6d34-44c7-bbc7-6c4661102e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:20.093150 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264197c7-6d34-44c7-bbc7-6c4661102e1c service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:20.093435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264197c7-6d34-44c7-bbc7-6c4661102e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:20.093710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264197c7-6d34-44c7-bbc7-6c4661102e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:20.095439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-264197c7-6d34-44c7-bbc7-6c4661102e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:20.105883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264197c7-6d34-44c7-bbc7-6c4661102e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:20.107964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264197c7-6d34-44c7-bbc7-6c4661102e1c service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:20.116405 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1316/2636] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:20.891809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a00146-a4a8-4432-958c-3b1486c0e280 service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:20.893492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-20a00146-a4a8-4432-958c-3b1486c0e280 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:20.910377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a00146-a4a8-4432-958c-3b1486c0e280 service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:20.916012 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1282d-a1f9-46f2-9907-2b37b2e8d3e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:20.916609 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1282d-a1f9-46f2-9907-2b37b2e8d3e7 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:20.916930 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1282d-a1f9-46f2-9907-2b37b2e8d3e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:20.917437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1282d-a1f9-46f2-9907-2b37b2e8d3e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:20.919597 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-76e1282d-a1f9-46f2-9907-2b37b2e8d3e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:20.934292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1282d-a1f9-46f2-9907-2b37b2e8d3e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:20.936687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1282d-a1f9-46f2-9907-2b37b2e8d3e7 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:20.949632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1321/2637] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:25.608986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264197c7-6d34-44c7-bbc7-6c4661102e1c service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:25.622008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264197c7-6d34-44c7-bbc7-6c4661102e1c service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:25.628684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026ac0-3f63-477c-a0b3-b1924ea4f102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:25.629289 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026ac0-3f63-477c-a0b3-b1924ea4f102 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:25.629568 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026ac0-3f63-477c-a0b3-b1924ea4f102 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:25.629871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026ac0-3f63-477c-a0b3-b1924ea4f102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:25.631727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7f026ac0-3f63-477c-a0b3-b1924ea4f102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:25.644536 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f026ac0-3f63-477c-a0b3-b1924ea4f102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:25.646247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f026ac0-3f63-477c-a0b3-b1924ea4f102 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:25.657485 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1317/2638] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:26.670990 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1282d-a1f9-46f2-9907-2b37b2e8d3e7 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:26.685247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1282d-a1f9-46f2-9907-2b37b2e8d3e7 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:26.691541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bc645-f37e-436b-abad-f743657159e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:26.692198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc645-f37e-436b-abad-f743657159e3 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:26.692480 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc645-f37e-436b-abad-f743657159e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:26.696852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc645-f37e-436b-abad-f743657159e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:26.696852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-967bc645-f37e-436b-abad-f743657159e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:26.706940 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bc645-f37e-436b-abad-f743657159e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:26.708555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bc645-f37e-436b-abad-f743657159e3 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:26.719719 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1322/2639] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:32.315105 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026ac0-3f63-477c-a0b3-b1924ea4f102 service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:32.324471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026ac0-3f63-477c-a0b3-b1924ea4f102 service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:32.328101 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c7638-0b89-4fe6-b8f0-989d9f92f4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:32.328700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c7638-0b89-4fe6-b8f0-989d9f92f4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:32.328976 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c7638-0b89-4fe6-b8f0-989d9f92f4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:32.329249 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c7638-0b89-4fe6-b8f0-989d9f92f4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:32.330959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a31c7638-0b89-4fe6-b8f0-989d9f92f4c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:32.398258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c7638-0b89-4fe6-b8f0-989d9f92f4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:32.399691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c7638-0b89-4fe6-b8f0-989d9f92f4c7 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:32.409370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1318/2640] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:35.577865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bc645-f37e-436b-abad-f743657159e3 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:35.589484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bc645-f37e-436b-abad-f743657159e3 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:35.593613 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b0766-edc5-43ae-b4ee-7ef00027255a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:35.594523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0766-edc5-43ae-b4ee-7ef00027255a service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:35.595016 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0766-edc5-43ae-b4ee-7ef00027255a service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:35.595593 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0766-edc5-43ae-b4ee-7ef00027255a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:35.607837 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b0766-edc5-43ae-b4ee-7ef00027255a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:35.609421 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b0766-edc5-43ae-b4ee-7ef00027255a service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:35.636311 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1323/2641] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:36.402364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac6dd7-2e6d-4cea-9903-b84d4d466c3d None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:36.407083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac6dd7-2e6d-4cea-9903-b84d4d466c3d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:36.407083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac6dd7-2e6d-4cea-9903-b84d4d466c3d None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:36.407083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1319/2642] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:37:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 09:37:36.435679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977d028-4fb0-45ac-b4c5-2b49493efdd9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:36.435679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977d028-4fb0-45ac-b4c5-2b49493efdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:36.435679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977d028-4fb0-45ac-b4c5-2b49493efdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:36.442101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=60 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:36.456897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9977d028-4fb0-45ac-b4c5-2b49493efdd9 None None] MFA Rules not processed for user `d1d19d1439914eac9993bf31fa4c9384`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:37:36.458975 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9977d028-4fb0-45ac-b4c5-2b49493efdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:36.468531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1324/2643] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:37:36.479765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac6dd7-2e6d-4cea-9903-b84d4d466c3d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:36.487745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=72 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:36.494539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac6dd7-2e6d-4cea-9903-b84d4d466c3d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:36.499714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6df72-a3d2-4d6c-bcb1-08d39c56a136 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:36.500449 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6df72-a3d2-4d6c-bcb1-08d39c56a136 service placement] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:36.500727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6df72-a3d2-4d6c-bcb1-08d39c56a136 service placement] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:36.500998 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6df72-a3d2-4d6c-bcb1-08d39c56a136 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:36.509965 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6df72-a3d2-4d6c-bcb1-08d39c56a136 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:36.512073 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6df72-a3d2-4d6c-bcb1-08d39c56a136 service placement] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:36.522413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1320/2644] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:36.555295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977d028-4fb0-45ac-b4c5-2b49493efdd9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:36.557453 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9977d028-4fb0-45ac-b4c5-2b49493efdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:36.573820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977d028-4fb0-45ac-b4c5-2b49493efdd9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:36.579039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:36.579702 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:36.579998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:36.580274 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] PATH_INFO: `/v3/users/702b8f59f5d348acb1263f058aed84a2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:36.581424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=702b8f59f5d348acb1263f058aed84a2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:36.583350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:36.738928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702b8f59f5d348acb1263f058aed84a2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:37:36.791101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702b8f59f5d348acb1263f058aed84a2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:37:36.799266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702b8f59f5d348acb1263f058aed84a2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:37:36.799996 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702b8f59f5d348acb1263f058aed84a2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:37:36.813448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b957a86a-100f-4594-8f50-8375332df55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702b8f59f5d348acb1263f058aed84a2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:37:36.822856 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1325/2645] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:37:36 2022] DELETE /identity/v3/users/702b8f59f5d348acb1263f058aed84a2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:37:37.068596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6df72-a3d2-4d6c-bcb1-08d39c56a136 service placement] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:37.081761 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6df72-a3d2-4d6c-bcb1-08d39c56a136 service placement] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:37.145567 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:37.146202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:37.146476 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:37.146742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] PATH_INFO: `/v3/projects/8600c7f983464790bd62b515d487ce76` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:37.147842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8600c7f983464790bd62b515d487ce76)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:37.149754 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:37.280637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8600c7f983464790bd62b515d487ce76', 'request_id': 'req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:37:37.286269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8600c7f983464790bd62b515d487ce76', 'request_id': 'req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:37:37.292507 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8600c7f983464790bd62b515d487ce76', 'request_id': 'req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:37:37.374307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] The token cache is being invalidate because project 8600c7f983464790bd62b515d487ce76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:37:37.374654 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:37:37.375269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e7dfb53e-9e3c-4bf4-8d9c-307c68f699c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:37:37.377398 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1321/2646] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:37:37 2022] DELETE /identity/v3/projects/8600c7f983464790bd62b515d487ce76 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:37:37.382172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3565b-04f0-40d1-8dbd-70b2fbb115f9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:37.382432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3565b-04f0-40d1-8dbd-70b2fbb115f9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:37.382726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3565b-04f0-40d1-8dbd-70b2fbb115f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:37.402975 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1cc3565b-04f0-40d1-8dbd-70b2fbb115f9 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:37:37.404802 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1cc3565b-04f0-40d1-8dbd-70b2fbb115f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:37.464977 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1326/2647] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:37:37.472842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece500d6-0cf5-4a98-90e4-3fa7aae141a1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:37.473365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece500d6-0cf5-4a98-90e4-3fa7aae141a1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:37.473365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece500d6-0cf5-4a98-90e4-3fa7aae141a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:37.493238 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ece500d6-0cf5-4a98-90e4-3fa7aae141a1 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:37:37.497733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ece500d6-0cf5-4a98-90e4-3fa7aae141a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:37.505519 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1322/2648] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:37:37.515527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3565b-04f0-40d1-8dbd-70b2fbb115f9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:37.525306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3565b-04f0-40d1-8dbd-70b2fbb115f9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:37.530081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee835a-9150-4821-8ab5-d6e9da0b40db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:37.530731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee835a-9150-4821-8ab5-d6e9da0b40db admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:37.530958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee835a-9150-4821-8ab5-d6e9da0b40db admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:37.531228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee835a-9150-4821-8ab5-d6e9da0b40db admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:37.531918 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee835a-9150-4821-8ab5-d6e9da0b40db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:37:37.532246 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee835a-9150-4821-8ab5-d6e9da0b40db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:37.533847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee835a-9150-4821-8ab5-d6e9da0b40db admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:37.545977 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1327/2649] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:37:37.550606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece500d6-0cf5-4a98-90e4-3fa7aae141a1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:37.560658 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece500d6-0cf5-4a98-90e4-3fa7aae141a1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:37.565434 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bb73e-8966-45e4-a678-093350b537d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:37.566039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bb73e-8966-45e4-a678-093350b537d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:37.566315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bb73e-8966-45e4-a678-093350b537d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:37.566584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bb73e-8966-45e4-a678-093350b537d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:37.567218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bb73e-8966-45e4-a678-093350b537d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:37.569417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bb73e-8966-45e4-a678-093350b537d7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:37.683334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1323/2650] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:37:37 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:37:37.684546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee835a-9150-4821-8ab5-d6e9da0b40db admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:37.695211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee835a-9150-4821-8ab5-d6e9da0b40db admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:37.750270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:37.758144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ff966-54ac-4852-b51b-d2e5b243256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:37.763600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ff966-54ac-4852-b51b-d2e5b243256c admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:37.763600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ff966-54ac-4852-b51b-d2e5b243256c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:37.763600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ff966-54ac-4852-b51b-d2e5b243256c admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:37.763600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ff966-54ac-4852-b51b-d2e5b243256c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:37.763600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ff966-54ac-4852-b51b-d2e5b243256c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:37.866813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1328/2651] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:37:37 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:37:37.872915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bb73e-8966-45e4-a678-093350b537d7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:37.895817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bb73e-8966-45e4-a678-093350b537d7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:37.910066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd07b21-09ee-4efb-b8ce-a39ea9099da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:37.910979 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd07b21-09ee-4efb-b8ce-a39ea9099da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:37.911250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd07b21-09ee-4efb-b8ce-a39ea9099da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:37.911530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd07b21-09ee-4efb-b8ce-a39ea9099da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:37.912216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd07b21-09ee-4efb-b8ce-a39ea9099da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:37.913836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd07b21-09ee-4efb-b8ce-a39ea9099da7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:37.936882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1324/2652] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:37:37.940973 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ff966-54ac-4852-b51b-d2e5b243256c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:37.952204 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ff966-54ac-4852-b51b-d2e5b243256c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:37.957698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5afe2-f0dd-4bb9-b0bd-e258171bed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:37.958931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5afe2-f0dd-4bb9-b0bd-e258171bed34 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:37.959372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5afe2-f0dd-4bb9-b0bd-e258171bed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:37.959793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5afe2-f0dd-4bb9-b0bd-e258171bed34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:37.960647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5afe2-f0dd-4bb9-b0bd-e258171bed34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:37.962517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5afe2-f0dd-4bb9-b0bd-e258171bed34 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:37.976113 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1329/2653] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:37:37.981036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd07b21-09ee-4efb-b8ce-a39ea9099da7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:37.998579 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd07b21-09ee-4efb-b8ce-a39ea9099da7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:38.005081 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb4fe-a14a-4948-8142-b1ca34b64543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:38.005955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb4fe-a14a-4948-8142-b1ca34b64543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:38.007821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb4fe-a14a-4948-8142-b1ca34b64543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:38.012181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb4fe-a14a-4948-8142-b1ca34b64543 admin admin] PATH_INFO: `/v3/projects/c5c1195605d242d0b9bec974895d787d/users/0fd534622807455aac7ede0283e3e31e/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:38.040774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb4fe-a14a-4948-8142-b1ca34b64543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c1195605d242d0b9bec974895d787d, user_id=0fd534622807455aac7ede0283e3e31e, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:38.041334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb4fe-a14a-4948-8142-b1ca34b64543 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:38.126016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1325/2654] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:37:37 2022] PUT /identity/v3/projects/c5c1195605d242d0b9bec974895d787d/users/0fd534622807455aac7ede0283e3e31e/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:37:38.126692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3547ee6-4f4d-4875-a698-838688163b5e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:38.127156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3547ee6-4f4d-4875-a698-838688163b5e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:38.127365 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3547ee6-4f4d-4875-a698-838688163b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:38.147938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b3547ee6-4f4d-4875-a698-838688163b5e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:37:38.149390 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b3547ee6-4f4d-4875-a698-838688163b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:38.221293 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1330/2655] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:37:38.233985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb4fe-a14a-4948-8142-b1ca34b64543 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:38.235834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ddabb4fe-a14a-4948-8142-b1ca34b64543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:38.258484 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:38.308577 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb4fe-a14a-4948-8142-b1ca34b64543 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:38.313194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd519feb-8deb-47be-88de-127dd75b5876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:38.313905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd519feb-8deb-47be-88de-127dd75b5876 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:38.314245 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd519feb-8deb-47be-88de-127dd75b5876 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:38.314580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd519feb-8deb-47be-88de-127dd75b5876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:38.325112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd519feb-8deb-47be-88de-127dd75b5876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:38.327618 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd519feb-8deb-47be-88de-127dd75b5876 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:38.339461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1326/2656] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:44.746592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e739ad-73c5-4afc-94e9-2192c997b368 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:44.747265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e739ad-73c5-4afc-94e9-2192c997b368 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:44.747921 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e739ad-73c5-4afc-94e9-2192c997b368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:44.776404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-73e739ad-73c5-4afc-94e9-2192c997b368 None None] MFA Rules not processed for user `0fd534622807455aac7ede0283e3e31e`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:37:44.777611 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-73e739ad-73c5-4afc-94e9-2192c997b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:44.844310 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1331/2657] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:37:44.859729 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd519feb-8deb-47be-88de-127dd75b5876 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:44.864076 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fd519feb-8deb-47be-88de-127dd75b5876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:44.945862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd519feb-8deb-47be-88de-127dd75b5876 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:45.011012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b36ff-28f4-43bc-a7e4-2da8feb3887f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:45.011012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b36ff-28f4-43bc-a7e4-2da8feb3887f service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:45.011012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b36ff-28f4-43bc-a7e4-2da8feb3887f service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:45.011012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b36ff-28f4-43bc-a7e4-2da8feb3887f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:45.012024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b36ff-28f4-43bc-a7e4-2da8feb3887f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:45.012024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b36ff-28f4-43bc-a7e4-2da8feb3887f service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:45.012024 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1327/2658] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:47.502795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75f9b-c0d1-4e88-b728-7bb5e0f09cc4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:47.503633 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75f9b-c0d1-4e88-b728-7bb5e0f09cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:47.513579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75f9b-c0d1-4e88-b728-7bb5e0f09cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:47.524185 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2be75f9b-c0d1-4e88-b728-7bb5e0f09cc4 None None] MFA Rules not processed for user `0fd534622807455aac7ede0283e3e31e`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:37:47.525487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2be75f9b-c0d1-4e88-b728-7bb5e0f09cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:47.533532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1332/2659] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:37:47.864838 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b36ff-28f4-43bc-a7e4-2da8feb3887f service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:47.875870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b36ff-28f4-43bc-a7e4-2da8feb3887f service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:47.880112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11f247-1fff-4fe7-97a5-9b1fd2c6f513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:47.880774 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f247-1fff-4fe7-97a5-9b1fd2c6f513 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:47.881170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f247-1fff-4fe7-97a5-9b1fd2c6f513 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:47.881442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f247-1fff-4fe7-97a5-9b1fd2c6f513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:47.883145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9c11f247-1fff-4fe7-97a5-9b1fd2c6f513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:47.893913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11f247-1fff-4fe7-97a5-9b1fd2c6f513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:47.895434 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11f247-1fff-4fe7-97a5-9b1fd2c6f513 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:47.904391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1328/2660] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:37:55.311770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115ac83-a64b-4479-93d3-263cd59826c0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:55.312314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115ac83-a64b-4479-93d3-263cd59826c0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:55.312314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115ac83-a64b-4479-93d3-263cd59826c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:55.332104 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9115ac83-a64b-4479-93d3-263cd59826c0 None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:37:55.333343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9115ac83-a64b-4479-93d3-263cd59826c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:55.400958 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1333/2661] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:37:55.416864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11f247-1fff-4fe7-97a5-9b1fd2c6f513 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:37:55.419049 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9c11f247-1fff-4fe7-97a5-9b1fd2c6f513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:37:55.490556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11f247-1fff-4fe7-97a5-9b1fd2c6f513 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:37:55.496112 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfbc10-6906-48b0-9cd4-bef1eea39740 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:37:55.496728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfbc10-6906-48b0-9cd4-bef1eea39740 service swift] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:37:55.497008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfbc10-6906-48b0-9cd4-bef1eea39740 service swift] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:37:55.497311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfbc10-6906-48b0-9cd4-bef1eea39740 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:37:55.512986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfbc10-6906-48b0-9cd4-bef1eea39740 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:37:55.515030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfbc10-6906-48b0-9cd4-bef1eea39740 service swift] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:37:55.531852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1329/2662] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:37:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:38:05.390010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:05.521108 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:09.472449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115ac83-a64b-4479-93d3-263cd59826c0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:38:09.474607 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9115ac83-a64b-4479-93d3-263cd59826c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:09.493974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115ac83-a64b-4479-93d3-263cd59826c0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:38:09.500861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa97016-1d36-4b22-8cb5-47252d1b9d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:38:09.501846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97016-1d36-4b22-8cb5-47252d1b9d47 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:09.502300 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97016-1d36-4b22-8cb5-47252d1b9d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:09.502750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97016-1d36-4b22-8cb5-47252d1b9d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:09.508156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0aa97016-1d36-4b22-8cb5-47252d1b9d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:09.525118 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa97016-1d36-4b22-8cb5-47252d1b9d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:38:09.533140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa97016-1d36-4b22-8cb5-47252d1b9d47 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:38:09.538168 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1334/2663] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:38:13.706468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4c364-5e92-43df-afd6-e883439232cd None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:13.707050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4c364-5e92-43df-afd6-e883439232cd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:13.707248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4c364-5e92-43df-afd6-e883439232cd None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:13.708874 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1330/2664] 10.222.0.55 () {54 vars in 921 bytes} [Fri Sep 2 09:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:38:13.714591 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1afe98-29c2-4705-9a1f-948bb45be5fb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:13.715108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1afe98-29c2-4705-9a1f-948bb45be5fb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:13.715445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1afe98-29c2-4705-9a1f-948bb45be5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:13.736890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5b1afe98-29c2-4705-9a1f-948bb45be5fb None None] MFA Rules not processed for user `5d74d78932554527a8bcb5880b2b9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:38:13.738417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5b1afe98-29c2-4705-9a1f-948bb45be5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:13.752749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1335/2665] 10.222.0.55 () {58 vars in 1018 bytes} [Fri Sep 2 09:38:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:38:13.760985 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4c364-5e92-43df-afd6-e883439232cd None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:38:13.763840 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-cee4c364-5e92-43df-afd6-e883439232cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:13.855823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4c364-5e92-43df-afd6-e883439232cd None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:38:13.860095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d7ac0-6839-4bcc-b861-b9747366f1f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6267b159204df7af8a4f84d227f88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:38:13.860881 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d7ac0-6839-4bcc-b861-b9747366f1f6 service glance] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:13.861306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d7ac0-6839-4bcc-b861-b9747366f1f6 service glance] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:13.861746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d7ac0-6839-4bcc-b861-b9747366f1f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:13.873103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d7ac0-6839-4bcc-b861-b9747366f1f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:38:13.874541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d7ac0-6839-4bcc-b861-b9747366f1f6 service glance] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:38:13.889350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1331/2666] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:38:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:38:16.943313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1afe98-29c2-4705-9a1f-948bb45be5fb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:38:16.944811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5b1afe98-29c2-4705-9a1f-948bb45be5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:16.963006 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1afe98-29c2-4705-9a1f-948bb45be5fb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:38:16.973052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:38:16.973052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:16.973052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:16.973052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] PATH_INFO: `/v3/users/4d6e2fea3aeb479685e6f9dbaf6b5dea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:16.973466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6e2fea3aeb479685e6f9dbaf6b5dea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:38:16.974526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:38:17.173471 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6e2fea3aeb479685e6f9dbaf6b5dea'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:17.237708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6e2fea3aeb479685e6f9dbaf6b5dea'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:17.245387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6e2fea3aeb479685e6f9dbaf6b5dea'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:17.246125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6e2fea3aeb479685e6f9dbaf6b5dea'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:17.259237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6ad616b4-cbb0-41c7-a789-05fed4d3c8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6e2fea3aeb479685e6f9dbaf6b5dea'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:17.265616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1336/2667] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:38:16 2022] DELETE /identity/v3/users/4d6e2fea3aeb479685e6f9dbaf6b5dea => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:38:17.765091 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d7ac0-6839-4bcc-b861-b9747366f1f6 service glance] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:38:17.777350 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d7ac0-6839-4bcc-b861-b9747366f1f6 service glance] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:38:17.850157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:38:17.850374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:17.850659 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:17.850951 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] PATH_INFO: `/v3/projects/475cd286bbe246409f13d1ba43d11dc4` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:17.852113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475cd286bbe246409f13d1ba43d11dc4)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:38:17.854193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:38:17.964586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475cd286bbe246409f13d1ba43d11dc4', 'request_id': 'req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:17.970391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475cd286bbe246409f13d1ba43d11dc4', 'request_id': 'req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:17.980493 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475cd286bbe246409f13d1ba43d11dc4', 'request_id': 'req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:18.019651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c807f-c56b-41b3-8434-e471b70ccc38 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:18.020164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c807f-c56b-41b3-8434-e471b70ccc38 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:18.020265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c807f-c56b-41b3-8434-e471b70ccc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:18.039925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-504c807f-c56b-41b3-8434-e471b70ccc38 None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:38:18.041042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-504c807f-c56b-41b3-8434-e471b70ccc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:18.060583 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] The token cache is being invalidate because project 475cd286bbe246409f13d1ba43d11dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:38:18.066716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:18.066716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:18.066716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1332/2668] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:38:17 2022] DELETE /identity/v3/projects/475cd286bbe246409f13d1ba43d11dc4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:38:18.067751 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:38:18.069225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:18.099512 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1337/2669] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:38:18.108033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:18.111763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c807f-c56b-41b3-8434-e471b70ccc38 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:38:18.113224 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-504c807f-c56b-41b3-8434-e471b70ccc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:18.138103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be30e25-9d6f-49fd-9d89-cbaf22726ba5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:38:18.143526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:38:18.144184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:18.144463 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:18.144733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] PATH_INFO: `/v3/users/6ff415d9fc54474180bb143881a5da02` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:18.145866 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff415d9fc54474180bb143881a5da02)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:38:18.147791 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:38:18.169931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:18.184611 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c807f-c56b-41b3-8434-e471b70ccc38 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:38:18.190668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c87aac-5ec7-45d4-96c3-467272aa747c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:38:18.191351 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c87aac-5ec7-45d4-96c3-467272aa747c service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:18.191632 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c87aac-5ec7-45d4-96c3-467272aa747c service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:18.191939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c87aac-5ec7-45d4-96c3-467272aa747c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:18.200234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c87aac-5ec7-45d4-96c3-467272aa747c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:38:18.203148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c87aac-5ec7-45d4-96c3-467272aa747c service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:38:18.211256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1338/2670] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:38:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 02 09:38:18.274960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff415d9fc54474180bb143881a5da02'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:18.275686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff415d9fc54474180bb143881a5da02'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:18.287423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff415d9fc54474180bb143881a5da02'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:18.294274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff415d9fc54474180bb143881a5da02'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:18.358348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-397e6b81-8887-4c9c-ac82-ecb53287c142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff415d9fc54474180bb143881a5da02'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:18.367302 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1333/2671] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:38:18 2022] DELETE /identity/v3/users/6ff415d9fc54474180bb143881a5da02 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:38:18.687368 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c87aac-5ec7-45d4-96c3-467272aa747c service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:38:18.717499 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c87aac-5ec7-45d4-96c3-467272aa747c service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:38:18.814195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:38:18.814831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:18.815107 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:18.815601 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] PATH_INFO: `/v3/projects/e609ac813be142cb9b3d0ca4378c856c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:18.817333 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e609ac813be142cb9b3d0ca4378c856c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:38:18.819383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:38:18.948141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e609ac813be142cb9b3d0ca4378c856c', 'request_id': 'req-6e905bf9-d80e-4304-b174-0192ac4dea52'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:18.959318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e609ac813be142cb9b3d0ca4378c856c', 'request_id': 'req-6e905bf9-d80e-4304-b174-0192ac4dea52'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:18.967709 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e609ac813be142cb9b3d0ca4378c856c', 'request_id': 'req-6e905bf9-d80e-4304-b174-0192ac4dea52'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:19.026343 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] The token cache is being invalidate because project e609ac813be142cb9b3d0ca4378c856c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:38:19.027010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:19.027450 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:38:19.030557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1339/2672] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:38:18 2022] DELETE /identity/v3/projects/e609ac813be142cb9b3d0ca4378c856c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:38:28.398804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:29.022749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:32.820385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcffc94-67f3-4998-a087-7876b3a96234 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:32.820879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcffc94-67f3-4998-a087-7876b3a96234 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:32.821036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcffc94-67f3-4998-a087-7876b3a96234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:32.841971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3dcffc94-67f3-4998-a087-7876b3a96234 None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:38:32.843121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3dcffc94-67f3-4998-a087-7876b3a96234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:32.899042 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1334/2673] 10.222.0.55 () {58 vars in 967 bytes} [Fri Sep 2 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:38:32.912048 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:38:32.913426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:32.980872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905bf9-d80e-4304-b174-0192ac4dea52 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:38:32.986464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51103a-9e13-4eac-b874-127c5cfd1cf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:38:32.987070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51103a-9e13-4eac-b874-127c5cfd1cf2 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:32.987346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51103a-9e13-4eac-b874-127c5cfd1cf2 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:32.987616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51103a-9e13-4eac-b874-127c5cfd1cf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:32.995570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51103a-9e13-4eac-b874-127c5cfd1cf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:38:32.997181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51103a-9e13-4eac-b874-127c5cfd1cf2 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:38:33.005290 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1340/2674] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:38:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:38:42.892362 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=25 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:43.001978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=32 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:45.377571 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab840-76df-4169-b0f4-1430305bc6b8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:38:45.378113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab840-76df-4169-b0f4-1430305bc6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:38:45.378113 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab840-76df-4169-b0f4-1430305bc6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:38:45.397372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-393ab840-76df-4169-b0f4-1430305bc6b8 None None] MFA Rules not processed for user `0fd534622807455aac7ede0283e3e31e`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:38:45.398551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-393ab840-76df-4169-b0f4-1430305bc6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:38:45.451404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1335/2675] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:38:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:38:55.444535 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=25 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:18.446899 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e013f01-bf46-4b42-b3f2-996301aa91e2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:39:18.447316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e013f01-bf46-4b42-b3f2-996301aa91e2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:39:18.447458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e013f01-bf46-4b42-b3f2-996301aa91e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:39:18.469080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8e013f01-bf46-4b42-b3f2-996301aa91e2 None None] MFA Rules not processed for user `8cef640d90d04f26b0f4abbb7ab33a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:39:18.470777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8e013f01-bf46-4b42-b3f2-996301aa91e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:39:18.527770 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1341/2676] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:39:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:39:19.744677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005c7c2-2502-4e68-9a4c-68d23c41e07b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:39:19.744677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005c7c2-2502-4e68-9a4c-68d23c41e07b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:39:19.744677 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005c7c2-2502-4e68-9a4c-68d23c41e07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:39:19.766293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-0005c7c2-2502-4e68-9a4c-68d23c41e07b None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:39:19.767622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0005c7c2-2502-4e68-9a4c-68d23c41e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:39:19.775309 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1336/2677] 10.222.0.55 () {58 vars in 967 bytes} [Fri Sep 2 09:39:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:39:19.800008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e013f01-bf46-4b42-b3f2-996301aa91e2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:39:19.812063 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e013f01-bf46-4b42-b3f2-996301aa91e2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:39:19.817493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3a23f-7b68-4ab1-b0e1-80cd7158c736 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:39:19.817679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a23f-7b68-4ab1-b0e1-80cd7158c736 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:39:19.817959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a23f-7b68-4ab1-b0e1-80cd7158c736 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:39:19.818232 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a23f-7b68-4ab1-b0e1-80cd7158c736 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:39:19.830376 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3a23f-7b68-4ab1-b0e1-80cd7158c736 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:39:19.832060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3a23f-7b68-4ab1-b0e1-80cd7158c736 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:39:19.843649 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1342/2678] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:39:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 02 09:39:29.267975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005c7c2-2502-4e68-9a4c-68d23c41e07b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:39:29.270242 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0005c7c2-2502-4e68-9a4c-68d23c41e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:39:29.413929 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005c7c2-2502-4e68-9a4c-68d23c41e07b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:39:29.419028 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:39:29.419782 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:39:29.420356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:39:29.420841 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] PATH_INFO: `/v3/users/4f9d9e41a62a40c58a8dfa463337bd59` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:39:29.422645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9d9e41a62a40c58a8dfa463337bd59)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:39:29.424770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:39:29.617655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9d9e41a62a40c58a8dfa463337bd59'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:29.618301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9d9e41a62a40c58a8dfa463337bd59'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:29.630696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9d9e41a62a40c58a8dfa463337bd59'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:29.638383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9d9e41a62a40c58a8dfa463337bd59'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:29.713274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9d9e41a62a40c58a8dfa463337bd59'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:29.720683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1337/2679] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:39:29 2022] DELETE /identity/v3/users/4f9d9e41a62a40c58a8dfa463337bd59 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:39:29.837872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=31 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:29.982491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3a23f-7b68-4ab1-b0e1-80cd7158c736 service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:39:30.022375 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3a23f-7b68-4ab1-b0e1-80cd7158c736 service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:39:30.085352 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:39:30.085986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:39:30.086260 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:39:30.086529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] PATH_INFO: `/v3/projects/ceb63d9cde63407e8bef35a2e20630f3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:39:30.087652 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb63d9cde63407e8bef35a2e20630f3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:39:30.089587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:39:30.188881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb63d9cde63407e8bef35a2e20630f3', 'request_id': 'req-c84dcc52-81fb-4818-9a05-495f499d768c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:30.194270 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb63d9cde63407e8bef35a2e20630f3', 'request_id': 'req-c84dcc52-81fb-4818-9a05-495f499d768c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:30.204971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb63d9cde63407e8bef35a2e20630f3', 'request_id': 'req-c84dcc52-81fb-4818-9a05-495f499d768c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:30.289751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] The token cache is being invalidate because project ceb63d9cde63407e8bef35a2e20630f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:39:30.290039 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:30.290656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:30.292167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1343/2680] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:39:29 2022] DELETE /identity/v3/projects/ceb63d9cde63407e8bef35a2e20630f3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:39:30.296164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:39:30.298053 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:39:30.311031 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e50e16-6f54-4831-92b0-5753746da945 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:39:30.319327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:30.369588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:39:30.370212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:39:30.370487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:39:30.370885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] PATH_INFO: `/v3/users/c3889065d1f44f6c87a3a71011908c68` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:39:30.372057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3889065d1f44f6c87a3a71011908c68)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:39:30.373958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:39:30.600530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3889065d1f44f6c87a3a71011908c68'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:30.601210 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3889065d1f44f6c87a3a71011908c68'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:30.613164 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3889065d1f44f6c87a3a71011908c68'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:30.619819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3889065d1f44f6c87a3a71011908c68'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:30.684612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f9523271-f7d5-4872-b701-1259cf296ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3889065d1f44f6c87a3a71011908c68'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:30.691637 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1338/2681] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:39:30 2022] DELETE /identity/v3/users/c3889065d1f44f6c87a3a71011908c68 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:39:30.909718 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:39:30.911372 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:39:30.927148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dcc52-81fb-4818-9a05-495f499d768c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:39:30.986108 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:39:30.986741 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:39:30.987051 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:39:30.987324 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] PATH_INFO: `/v3/projects/f2d45732e4ab4d958c73e256d9e54a3e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:39:30.988530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d45732e4ab4d958c73e256d9e54a3e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:39:30.990425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:39:30.998082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:31.078880 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d45732e4ab4d958c73e256d9e54a3e', 'request_id': 'req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:31.085035 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d45732e4ab4d958c73e256d9e54a3e', 'request_id': 'req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:31.092222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d45732e4ab4d958c73e256d9e54a3e', 'request_id': 'req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:31.166128 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] The token cache is being invalidate because project f2d45732e4ab4d958c73e256d9e54a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:39:31.166387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:31.167136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9eb5c37e-b9fe-49cc-8455-760635ee5bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:39:31.179909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1344/2682] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:39:30 2022] DELETE /identity/v3/projects/f2d45732e4ab4d958c73e256d9e54a3e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:39:40.947807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:41.162279 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:50.308040 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208b479-aca2-4eff-9796-a61981a00d89 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:39:50.308559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208b479-aca2-4eff-9796-a61981a00d89 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:39:50.308559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208b479-aca2-4eff-9796-a61981a00d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:39:50.327958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3208b479-aca2-4eff-9796-a61981a00d89 None None] MFA Rules not processed for user `0fd534622807455aac7ede0283e3e31e`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:39:50.329803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3208b479-aca2-4eff-9796-a61981a00d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:39:50.384385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1339/2683] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:39:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:40:00.377427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=25 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:31.083392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd3e2-3187-458e-93b8-d954fa92cd80 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:40:31.083978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd3e2-3187-458e-93b8-d954fa92cd80 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:40:31.083978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd3e2-3187-458e-93b8-d954fa92cd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:40:31.113541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-68acd3e2-3187-458e-93b8-d954fa92cd80 None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:40:31.114773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-68acd3e2-3187-458e-93b8-d954fa92cd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:40:31.200098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1345/2684] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:40:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:40:31.342418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208b479-aca2-4eff-9796-a61981a00d89 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:40:31.343964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3208b479-aca2-4eff-9796-a61981a00d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:40:31.416612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208b479-aca2-4eff-9796-a61981a00d89 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:40:31.421632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24658d1-4ced-44f6-8d52-ca6056092ad0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:40:31.422241 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24658d1-4ced-44f6-8d52-ca6056092ad0 service swift] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:40:31.422522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24658d1-4ced-44f6-8d52-ca6056092ad0 service swift] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:40:31.422796 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24658d1-4ced-44f6-8d52-ca6056092ad0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:40:31.432282 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24658d1-4ced-44f6-8d52-ca6056092ad0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:40:31.433974 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24658d1-4ced-44f6-8d52-ca6056092ad0 service swift] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:40:31.442016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1340/2685] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:40:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:40:34.280124 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd3e2-3187-458e-93b8-d954fa92cd80 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:40:34.281594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-68acd3e2-3187-458e-93b8-d954fa92cd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:40:34.373509 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd3e2-3187-458e-93b8-d954fa92cd80 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:40:34.378491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48601ad5-0ace-42b9-a76c-355dfb140f5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:40:34.379092 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601ad5-0ace-42b9-a76c-355dfb140f5a service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:40:34.379362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601ad5-0ace-42b9-a76c-355dfb140f5a service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:40:34.379636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601ad5-0ace-42b9-a76c-355dfb140f5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:40:34.381902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-48601ad5-0ace-42b9-a76c-355dfb140f5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:40:34.393449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48601ad5-0ace-42b9-a76c-355dfb140f5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:40:34.395023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48601ad5-0ace-42b9-a76c-355dfb140f5a service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:40:34.405486 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1346/2686] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:40:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:40:41.438772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=32 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:44.401230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=80 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:52.272632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df3b2a-695b-4571-a8c7-d2f07dc116ae None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:40:52.273135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df3b2a-695b-4571-a8c7-d2f07dc116ae None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:40:52.273326 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df3b2a-695b-4571-a8c7-d2f07dc116ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:40:52.293662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-67df3b2a-695b-4571-a8c7-d2f07dc116ae None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:40:52.294975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-67df3b2a-695b-4571-a8c7-d2f07dc116ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:40:52.302904 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1341/2687] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:40:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:40:52.315147 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48601ad5-0ace-42b9-a76c-355dfb140f5a service placement] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:40:52.326909 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48601ad5-0ace-42b9-a76c-355dfb140f5a service placement] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:40:52.331902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ab9ee-65bb-4196-b894-8995e6c5968a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:40:52.332589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ab9ee-65bb-4196-b894-8995e6c5968a service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:40:52.332877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ab9ee-65bb-4196-b894-8995e6c5968a service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:40:52.333149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ab9ee-65bb-4196-b894-8995e6c5968a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:40:52.342101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ab9ee-65bb-4196-b894-8995e6c5968a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:40:52.343677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ab9ee-65bb-4196-b894-8995e6c5968a service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:40:52.352257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1347/2688] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:40:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:41:02.287764 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:02.348619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:07.381827 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e002e52-bbab-4a78-98e3-7081379713cb None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:07.382313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e002e52-bbab-4a78-98e3-7081379713cb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:07.382411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e002e52-bbab-4a78-98e3-7081379713cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:07.401585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8e002e52-bbab-4a78-98e3-7081379713cb None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:41:07.403622 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8e002e52-bbab-4a78-98e3-7081379713cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:07.410201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1342/2689] 10.222.0.55 () {58 vars in 967 bytes} [Fri Sep 2 09:41:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:41:07.423170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ab9ee-65bb-4196-b894-8995e6c5968a service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:07.433998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ab9ee-65bb-4196-b894-8995e6c5968a service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:07.439853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f59c1b-5f6e-4e7c-bfbe-656045cae8b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:07.440478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59c1b-5f6e-4e7c-bfbe-656045cae8b9 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:07.440756 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59c1b-5f6e-4e7c-bfbe-656045cae8b9 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:07.441022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59c1b-5f6e-4e7c-bfbe-656045cae8b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:07.449808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f59c1b-5f6e-4e7c-bfbe-656045cae8b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:07.451491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f59c1b-5f6e-4e7c-bfbe-656045cae8b9 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:07.459870 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1348/2690] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:41:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:41:08.633419 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499de4-85c0-4ca8-b871-64f401a3b02f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:08.633914 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499de4-85c0-4ca8-b871-64f401a3b02f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:08.643987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499de4-85c0-4ca8-b871-64f401a3b02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:08.653190 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-03499de4-85c0-4ca8-b871-64f401a3b02f None None] MFA Rules not processed for user `0fd534622807455aac7ede0283e3e31e`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:41:08.654461 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-03499de4-85c0-4ca8-b871-64f401a3b02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:08.661453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1343/2691] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:41:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:41:17.456392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:18.647748 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:42.146007 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f59c1b-5f6e-4e7c-bfbe-656045cae8b9 service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:42.147468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-18f59c1b-5f6e-4e7c-bfbe-656045cae8b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:42.225619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f59c1b-5f6e-4e7c-bfbe-656045cae8b9 service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:42.229262 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52f674-0d70-44cf-88de-ba0cbcc4dd23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:42.229860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52f674-0d70-44cf-88de-ba0cbcc4dd23 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:42.230164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52f674-0d70-44cf-88de-ba0cbcc4dd23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:42.230434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52f674-0d70-44cf-88de-ba0cbcc4dd23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:42.232184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9c52f674-0d70-44cf-88de-ba0cbcc4dd23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:42.292635 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52f674-0d70-44cf-88de-ba0cbcc4dd23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:42.294055 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52f674-0d70-44cf-88de-ba0cbcc4dd23 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:42.303196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1349/2692] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:41:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:41:42.896422 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03499de4-85c0-4ca8-b871-64f401a3b02f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:42.897824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-03499de4-85c0-4ca8-b871-64f401a3b02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:42.974399 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03499de4-85c0-4ca8-b871-64f401a3b02f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:42.977992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eec50-ba1d-4a71-a7f3-7ccce6ce33bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:42.978595 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eec50-ba1d-4a71-a7f3-7ccce6ce33bb service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:42.978873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eec50-ba1d-4a71-a7f3-7ccce6ce33bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:42.979144 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eec50-ba1d-4a71-a7f3-7ccce6ce33bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:42.980855 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3f9eec50-ba1d-4a71-a7f3-7ccce6ce33bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:43.061525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9eec50-ba1d-4a71-a7f3-7ccce6ce33bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:43.062967 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9eec50-ba1d-4a71-a7f3-7ccce6ce33bb service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:43.083374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1344/2693] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:41:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:41:44.260458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52f674-0d70-44cf-88de-ba0cbcc4dd23 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:44.270495 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52f674-0d70-44cf-88de-ba0cbcc4dd23 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:44.274046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84121dc-99ca-4ef0-a2e9-225d98174274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:44.274666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84121dc-99ca-4ef0-a2e9-225d98174274 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:44.274972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84121dc-99ca-4ef0-a2e9-225d98174274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:44.275244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84121dc-99ca-4ef0-a2e9-225d98174274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:44.276985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c84121dc-99ca-4ef0-a2e9-225d98174274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:44.290024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84121dc-99ca-4ef0-a2e9-225d98174274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:44.291428 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84121dc-99ca-4ef0-a2e9-225d98174274 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:44.302164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1350/2694] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:41:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:41:51.284285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eec50-ba1d-4a71-a7f3-7ccce6ce33bb service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:51.293517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eec50-ba1d-4a71-a7f3-7ccce6ce33bb service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:51.297128 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc993b-5fbd-41fc-a234-5156250b4256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:51.297719 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc993b-5fbd-41fc-a234-5156250b4256 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:51.297997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc993b-5fbd-41fc-a234-5156250b4256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:51.298269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc993b-5fbd-41fc-a234-5156250b4256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:51.299982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f5fc993b-5fbd-41fc-a234-5156250b4256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:51.359062 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:51.361327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc993b-5fbd-41fc-a234-5156250b4256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:51.362771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc993b-5fbd-41fc-a234-5156250b4256 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:51.372108 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1345/2695] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:41:54.297429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=63 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:54.698256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84121dc-99ca-4ef0-a2e9-225d98174274 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:54.705036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c84121dc-99ca-4ef0-a2e9-225d98174274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:54.715575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84121dc-99ca-4ef0-a2e9-225d98174274 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:54.720237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:54.720865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:54.721137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:54.721405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] PATH_INFO: `/v3/users/8cef640d90d04f26b0f4abbb7ab33a4f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:54.723080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cef640d90d04f26b0f4abbb7ab33a4f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:54.725021 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:54.908412 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cef640d90d04f26b0f4abbb7ab33a4f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:41:54.980023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cef640d90d04f26b0f4abbb7ab33a4f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:41:54.987175 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cef640d90d04f26b0f4abbb7ab33a4f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:41:54.987851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cef640d90d04f26b0f4abbb7ab33a4f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:41:54.999438 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-18df8697-c479-450d-b4d8-8b4dff704277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cef640d90d04f26b0f4abbb7ab33a4f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:41:55.005317 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1351/2696] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:41:54 2022] DELETE /identity/v3/users/8cef640d90d04f26b0f4abbb7ab33a4f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:41:55.250181 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc993b-5fbd-41fc-a234-5156250b4256 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:55.260625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc993b-5fbd-41fc-a234-5156250b4256 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:55.317880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:55.318508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:55.318781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:55.319051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] PATH_INFO: `/v3/projects/282a3d9e81b447b4b60de8158bce71f3` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:55.320179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=282a3d9e81b447b4b60de8158bce71f3)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:55.322064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:55.464038 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282a3d9e81b447b4b60de8158bce71f3', 'request_id': 'req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:41:55.469525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282a3d9e81b447b4b60de8158bce71f3', 'request_id': 'req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:41:55.475788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282a3d9e81b447b4b60de8158bce71f3', 'request_id': 'req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:41:55.564901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] The token cache is being invalidate because project 282a3d9e81b447b4b60de8158bce71f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:41:55.565183 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:41:55.566435 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-52ca3b07-20ac-4f93-85f1-f9b909f7bdcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:41:55.567983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1346/2697] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:41:55 2022] DELETE /identity/v3/projects/282a3d9e81b447b4b60de8158bce71f3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:41:55.573183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7f47c-4b67-48cd-bda3-5d84872f3ebf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:55.573684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7f47c-4b67-48cd-bda3-5d84872f3ebf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:55.573795 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7f47c-4b67-48cd-bda3-5d84872f3ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:55.630527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-36e7f47c-4b67-48cd-bda3-5d84872f3ebf None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:41:55.631716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-36e7f47c-4b67-48cd-bda3-5d84872f3ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:55.687201 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1352/2698] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:41:55.695230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dca57-89c7-4c79-997d-0c46d6d03e1b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:55.695514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dca57-89c7-4c79-997d-0c46d6d03e1b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:55.695784 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dca57-89c7-4c79-997d-0c46d6d03e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:55.715467 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e53dca57-89c7-4c79-997d-0c46d6d03e1b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:41:55.716695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e53dca57-89c7-4c79-997d-0c46d6d03e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:55.724465 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1347/2699] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:41:55.728523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7f47c-4b67-48cd-bda3-5d84872f3ebf None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:55.738592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7f47c-4b67-48cd-bda3-5d84872f3ebf None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:55.743226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d951e-65e0-46b3-b532-913947ec33ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:55.743819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d951e-65e0-46b3-b532-913947ec33ac admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:55.744151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d951e-65e0-46b3-b532-913947ec33ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:55.744423 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d951e-65e0-46b3-b532-913947ec33ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:55.745064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d951e-65e0-46b3-b532-913947ec33ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:41:55.745366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d951e-65e0-46b3-b532-913947ec33ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:55.746953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d951e-65e0-46b3-b532-913947ec33ac admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:55.758966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1353/2700] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:41:55.763201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dca57-89c7-4c79-997d-0c46d6d03e1b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:55.772566 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dca57-89c7-4c79-997d-0c46d6d03e1b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:55.777154 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441ea16-3471-4e99-bb50-be8dbf2f2230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:55.777735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441ea16-3471-4e99-bb50-be8dbf2f2230 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:55.778006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441ea16-3471-4e99-bb50-be8dbf2f2230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:55.778273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441ea16-3471-4e99-bb50-be8dbf2f2230 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:55.778890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441ea16-3471-4e99-bb50-be8dbf2f2230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:55.780811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441ea16-3471-4e99-bb50-be8dbf2f2230 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:55.872716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1348/2701] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:41:55 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:41:55.876671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d951e-65e0-46b3-b532-913947ec33ac admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:55.887214 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d951e-65e0-46b3-b532-913947ec33ac admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:55.912149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:55.944678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f29356-71e7-484c-a8aa-69d9293a2fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:55.949467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f29356-71e7-484c-a8aa-69d9293a2fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:55.949467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f29356-71e7-484c-a8aa-69d9293a2fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:55.949467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f29356-71e7-484c-a8aa-69d9293a2fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:55.949467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f29356-71e7-484c-a8aa-69d9293a2fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:55.949467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f29356-71e7-484c-a8aa-69d9293a2fb3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:56.055307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1354/2702] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:41:55 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:41:56.059320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441ea16-3471-4e99-bb50-be8dbf2f2230 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:56.070455 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441ea16-3471-4e99-bb50-be8dbf2f2230 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:56.075051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff986e-1225-45c7-99ec-c2686cf357d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:56.075688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff986e-1225-45c7-99ec-c2686cf357d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.076015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff986e-1225-45c7-99ec-c2686cf357d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.076284 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff986e-1225-45c7-99ec-c2686cf357d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.076913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff986e-1225-45c7-99ec-c2686cf357d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:56.078491 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff986e-1225-45c7-99ec-c2686cf357d1 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:56.088304 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1349/2703] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:41:56.092312 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f29356-71e7-484c-a8aa-69d9293a2fb3 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:56.102904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f29356-71e7-484c-a8aa-69d9293a2fb3 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:56.107540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e30302-7b4d-4d0c-9a1a-01ef7f0b13d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:56.108238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e30302-7b4d-4d0c-9a1a-01ef7f0b13d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.108514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e30302-7b4d-4d0c-9a1a-01ef7f0b13d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.108806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e30302-7b4d-4d0c-9a1a-01ef7f0b13d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.109441 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e30302-7b4d-4d0c-9a1a-01ef7f0b13d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:56.111014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e30302-7b4d-4d0c-9a1a-01ef7f0b13d4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:56.121298 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1355/2704] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:41:56.125314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff986e-1225-45c7-99ec-c2686cf357d1 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:56.135097 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff986e-1225-45c7-99ec-c2686cf357d1 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:56.139986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbfdfe-e92d-4dda-bb8e-867229da768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:56.140620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbfdfe-e92d-4dda-bb8e-867229da768d admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.140898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbfdfe-e92d-4dda-bb8e-867229da768d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.141171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbfdfe-e92d-4dda-bb8e-867229da768d admin admin] PATH_INFO: `/v3/projects/42f7ebf084ee4d0591b99c0118cf968f/users/f3217bf2bb434c10ba07e2c984820772/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.155696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbfdfe-e92d-4dda-bb8e-867229da768d admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f7ebf084ee4d0591b99c0118cf968f, user_id=f3217bf2bb434c10ba07e2c984820772, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:56.158454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbfdfe-e92d-4dda-bb8e-867229da768d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:56.231094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1350/2705] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:41:56 2022] PUT /identity/v3/projects/42f7ebf084ee4d0591b99c0118cf968f/users/f3217bf2bb434c10ba07e2c984820772/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:41:56.243188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2cd9-df94-49c0-b195-20346b638b73 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.243489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2cd9-df94-49c0-b195-20346b638b73 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.243749 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2cd9-df94-49c0-b195-20346b638b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.272357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5f5a2cd9-df94-49c0-b195-20346b638b73 None None] MFA Rules not processed for user `f3217bf2bb434c10ba07e2c984820772`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:41:56.273541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5f5a2cd9-df94-49c0-b195-20346b638b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:56.334817 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1356/2706] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:41:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:41:56.339226 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbfdfe-e92d-4dda-bb8e-867229da768d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:56.353139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:56.400781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbfdfe-e92d-4dda-bb8e-867229da768d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:56.405427 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ca9c-dea3-4f63-b8ce-fd4bc69f4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:56.406022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ca9c-dea3-4f63-b8ce-fd4bc69f4969 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.406300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ca9c-dea3-4f63-b8ce-fd4bc69f4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.406571 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ca9c-dea3-4f63-b8ce-fd4bc69f4969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.407199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9ca9c-dea3-4f63-b8ce-fd4bc69f4969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:56.409124 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9ca9c-dea3-4f63-b8ce-fd4bc69f4969 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:56.506753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1351/2707] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:41:56 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:41:56.510777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a2cd9-df94-49c0-b195-20346b638b73 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:56.522460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a2cd9-df94-49c0-b195-20346b638b73 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:56.577944 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276da437-7659-4caa-9046-7cddc53cfb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:56.578595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276da437-7659-4caa-9046-7cddc53cfb89 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.578835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276da437-7659-4caa-9046-7cddc53cfb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.579109 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276da437-7659-4caa-9046-7cddc53cfb89 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.579728 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276da437-7659-4caa-9046-7cddc53cfb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:56.582162 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276da437-7659-4caa-9046-7cddc53cfb89 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:56.666282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1357/2708] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:41:56 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:41:56.670291 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ca9c-dea3-4f63-b8ce-fd4bc69f4969 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:56.680665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ca9c-dea3-4f63-b8ce-fd4bc69f4969 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:56.685380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa5278-1d9f-4f6c-8477-0eeb0171ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:56.685976 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa5278-1d9f-4f6c-8477-0eeb0171ffa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.686257 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa5278-1d9f-4f6c-8477-0eeb0171ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.686534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa5278-1d9f-4f6c-8477-0eeb0171ffa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.687192 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa5278-1d9f-4f6c-8477-0eeb0171ffa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:56.688833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa5278-1d9f-4f6c-8477-0eeb0171ffa7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:56.699545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1352/2709] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:41:56.703446 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276da437-7659-4caa-9046-7cddc53cfb89 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:56.713831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276da437-7659-4caa-9046-7cddc53cfb89 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:56.718458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e5126-18f3-4c4f-8b94-fc6342726fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:56.719149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5126-18f3-4c4f-8b94-fc6342726fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.719427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5126-18f3-4c4f-8b94-fc6342726fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.719699 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5126-18f3-4c4f-8b94-fc6342726fc3 admin admin] PATH_INFO: `/v3/projects/0042371985ae4284911a6670b94c4acc/users/790d84372b5b41e4a0ff47d5697d60a5/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.734780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e5126-18f3-4c4f-8b94-fc6342726fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0042371985ae4284911a6670b94c4acc, user_id=790d84372b5b41e4a0ff47d5697d60a5, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:56.737466 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e5126-18f3-4c4f-8b94-fc6342726fc3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:56.835069 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1358/2710] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:41:56 2022] PUT /identity/v3/projects/0042371985ae4284911a6670b94c4acc/users/790d84372b5b41e4a0ff47d5697d60a5/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:41:56.839109 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa5278-1d9f-4f6c-8477-0eeb0171ffa7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:56.849788 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa5278-1d9f-4f6c-8477-0eeb0171ffa7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:56.905665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a2c84-72b7-4168-915d-59227d757d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:56.906265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a2c84-72b7-4168-915d-59227d757d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.906541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a2c84-72b7-4168-915d-59227d757d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.906813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a2c84-72b7-4168-915d-59227d757d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.907441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a2c84-72b7-4168-915d-59227d757d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:56.909059 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a2c84-72b7-4168-915d-59227d757d59 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:56.918769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1353/2711] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:41:56.923049 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e5126-18f3-4c4f-8b94-fc6342726fc3 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:56.928589 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:56.933865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e5126-18f3-4c4f-8b94-fc6342726fc3 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:56.938555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f26b-fa8a-433d-bfd8-7defde34f0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:56.939198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f26b-fa8a-433d-bfd8-7defde34f0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.939474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f26b-fa8a-433d-bfd8-7defde34f0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.939744 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f26b-fa8a-433d-bfd8-7defde34f0d5 admin admin] PATH_INFO: `/v3/projects/0042371985ae4284911a6670b94c4acc/users/790d84372b5b41e4a0ff47d5697d60a5/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.942250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5f26b-fa8a-433d-bfd8-7defde34f0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0042371985ae4284911a6670b94c4acc, user_id=790d84372b5b41e4a0ff47d5697d60a5, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:56.944938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5f26b-fa8a-433d-bfd8-7defde34f0d5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:56.954861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1359/2712] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:41:56 2022] PUT /identity/v3/projects/0042371985ae4284911a6670b94c4acc/users/790d84372b5b41e4a0ff47d5697d60a5/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:41:56.965688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31989342-3d74-447e-99ee-1c08255bf827 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:56.965999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31989342-3d74-447e-99ee-1c08255bf827 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:56.966273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31989342-3d74-447e-99ee-1c08255bf827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:56.993994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-31989342-3d74-447e-99ee-1c08255bf827 None None] MFA Rules not processed for user `790d84372b5b41e4a0ff47d5697d60a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:41:56.995231 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-31989342-3d74-447e-99ee-1c08255bf827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:57.062750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1354/2713] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:41:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:41:57.074361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f26b-fa8a-433d-bfd8-7defde34f0d5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:57.076074 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-81b5f26b-fa8a-433d-bfd8-7defde34f0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:41:57.132314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f26b-fa8a-433d-bfd8-7defde34f0d5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:57.135972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdbb1b-5d50-4edf-a261-5489fa8199b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:57.136568 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdbb1b-5d50-4edf-a261-5489fa8199b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:57.136847 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdbb1b-5d50-4edf-a261-5489fa8199b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:57.137122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdbb1b-5d50-4edf-a261-5489fa8199b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:57.146773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdbb1b-5d50-4edf-a261-5489fa8199b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:57.148238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdbb1b-5d50-4edf-a261-5489fa8199b0 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:57.157964 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1360/2714] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:41:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:41:57.359219 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31989342-3d74-447e-99ee-1c08255bf827 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:41:57.369328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31989342-3d74-447e-99ee-1c08255bf827 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:41:57.372854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395efa3-3961-46e0-95d8-e7218118004b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:41:57.373448 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395efa3-3961-46e0-95d8-e7218118004b service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:41:57.373727 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395efa3-3961-46e0-95d8-e7218118004b service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:41:57.373999 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395efa3-3961-46e0-95d8-e7218118004b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:41:57.379692 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:57.429561 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395efa3-3961-46e0-95d8-e7218118004b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:41:57.431409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395efa3-3961-46e0-95d8-e7218118004b service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:41:57.441826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1355/2715] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:41:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:07.154034 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:07.466869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=24 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:17.250777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdbb1b-5d50-4edf-a261-5489fa8199b0 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:17.252425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d8cdbb1b-5d50-4edf-a261-5489fa8199b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:17.324663 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdbb1b-5d50-4edf-a261-5489fa8199b0 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:17.329584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4daec-ac19-420a-ada0-406b2c5f0fd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:17.330207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4daec-ac19-420a-ada0-406b2c5f0fd2 service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:17.330481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4daec-ac19-420a-ada0-406b2c5f0fd2 service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:17.330750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4daec-ac19-420a-ada0-406b2c5f0fd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:17.332491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a4f4daec-ac19-420a-ada0-406b2c5f0fd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:17.343587 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4daec-ac19-420a-ada0-406b2c5f0fd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:17.345198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4daec-ac19-420a-ada0-406b2c5f0fd2 service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:17.355362 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1361/2716] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:17.372089 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395efa3-3961-46e0-95d8-e7218118004b service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:17.374201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2395efa3-3961-46e0-95d8-e7218118004b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:17.443575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395efa3-3961-46e0-95d8-e7218118004b service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:17.448696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:17.449331 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:17.449617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:17.449890 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] PATH_INFO: `/v3/users/0fd534622807455aac7ede0283e3e31e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:17.451030 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd534622807455aac7ede0283e3e31e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:17.453015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:17.634744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd534622807455aac7ede0283e3e31e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:17.635982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd534622807455aac7ede0283e3e31e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:17.648266 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd534622807455aac7ede0283e3e31e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:17.655185 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd534622807455aac7ede0283e3e31e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:17.723996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-22819441-07a3-4123-8179-8baffc2fb2ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd534622807455aac7ede0283e3e31e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:17.731314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1356/2717] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:17 2022] DELETE /identity/v3/users/0fd534622807455aac7ede0283e3e31e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:18.003819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4daec-ac19-420a-ada0-406b2c5f0fd2 service placement] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:18.014841 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4daec-ac19-420a-ada0-406b2c5f0fd2 service placement] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:18.076367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:18.076367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:18.076367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:18.076865 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] PATH_INFO: `/v3/projects/c5c1195605d242d0b9bec974895d787d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:18.077560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c1195605d242d0b9bec974895d787d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:18.079455 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:18.209070 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c1195605d242d0b9bec974895d787d', 'request_id': 'req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:18.215015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c1195605d242d0b9bec974895d787d', 'request_id': 'req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:18.221096 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c1195605d242d0b9bec974895d787d', 'request_id': 'req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:18.277257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] The token cache is being invalidate because project c5c1195605d242d0b9bec974895d787d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:18.277866 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:18.278193 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a1f07a4-fc3d-4628-b5d5-7aef5ffd8b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:18.279762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1362/2718] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:18 2022] DELETE /identity/v3/projects/c5c1195605d242d0b9bec974895d787d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:18.284647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da52070-f13e-46c4-a062-fe7c0620acc4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:18.287750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da52070-f13e-46c4-a062-fe7c0620acc4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:18.287750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da52070-f13e-46c4-a062-fe7c0620acc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:18.306673 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1da52070-f13e-46c4-a062-fe7c0620acc4 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:18.307861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1da52070-f13e-46c4-a062-fe7c0620acc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:18.367984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1357/2719] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:18.375581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2299-3b7c-497f-8eb3-79e213822c8e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:18.375864 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2299-3b7c-497f-8eb3-79e213822c8e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:18.376165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2299-3b7c-497f-8eb3-79e213822c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:18.395532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8fde2299-3b7c-497f-8eb3-79e213822c8e None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:18.396746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8fde2299-3b7c-497f-8eb3-79e213822c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:18.405041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1363/2720] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:18.409068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da52070-f13e-46c4-a062-fe7c0620acc4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:18.419426 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da52070-f13e-46c4-a062-fe7c0620acc4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:18.424066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66563d-b225-4f81-8665-07db50c255a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:18.424664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66563d-b225-4f81-8665-07db50c255a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:18.424949 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66563d-b225-4f81-8665-07db50c255a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:18.425222 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66563d-b225-4f81-8665-07db50c255a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:18.425863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66563d-b225-4f81-8665-07db50c255a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:42:18.426165 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66563d-b225-4f81-8665-07db50c255a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:18.427754 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66563d-b225-4f81-8665-07db50c255a7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:18.439094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1358/2721] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:42:18.443230 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde2299-3b7c-497f-8eb3-79e213822c8e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:18.452715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde2299-3b7c-497f-8eb3-79e213822c8e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:18.457307 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85130c01-5727-4306-901e-63ee05a7af87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:18.457882 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85130c01-5727-4306-901e-63ee05a7af87 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:18.458157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85130c01-5727-4306-901e-63ee05a7af87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:18.458425 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85130c01-5727-4306-901e-63ee05a7af87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:18.459050 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85130c01-5727-4306-901e-63ee05a7af87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:18.460972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85130c01-5727-4306-901e-63ee05a7af87 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:18.472255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:18.573732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1364/2722] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:18 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:18.577873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66563d-b225-4f81-8665-07db50c255a7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:18.588033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66563d-b225-4f81-8665-07db50c255a7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:18.592227 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:18.645171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50481139-fb39-40fe-a7bc-0b78668e74d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:18.645705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50481139-fb39-40fe-a7bc-0b78668e74d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:18.645983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50481139-fb39-40fe-a7bc-0b78668e74d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:18.646360 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50481139-fb39-40fe-a7bc-0b78668e74d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:18.646996 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50481139-fb39-40fe-a7bc-0b78668e74d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:18.648955 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50481139-fb39-40fe-a7bc-0b78668e74d7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:18.737255 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1359/2723] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:18 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:18.741376 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85130c01-5727-4306-901e-63ee05a7af87 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:18.752166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85130c01-5727-4306-901e-63ee05a7af87 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:18.757030 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a819a-6146-4345-8d68-ded4d3350812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:18.757626 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a819a-6146-4345-8d68-ded4d3350812 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:18.757902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a819a-6146-4345-8d68-ded4d3350812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:18.758172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a819a-6146-4345-8d68-ded4d3350812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:18.758827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a819a-6146-4345-8d68-ded4d3350812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:18.760951 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a819a-6146-4345-8d68-ded4d3350812 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:18.772583 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1365/2724] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:18.780879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50481139-fb39-40fe-a7bc-0b78668e74d7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:18.791159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50481139-fb39-40fe-a7bc-0b78668e74d7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:18.795928 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee5280-b9dd-484a-b68e-88daa9b5f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:18.796605 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee5280-b9dd-484a-b68e-88daa9b5f9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:18.796869 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee5280-b9dd-484a-b68e-88daa9b5f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:18.797137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee5280-b9dd-484a-b68e-88daa9b5f9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:18.797839 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee5280-b9dd-484a-b68e-88daa9b5f9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:18.799459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee5280-b9dd-484a-b68e-88daa9b5f9eb admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:18.810735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1360/2725] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:18.814978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a819a-6146-4345-8d68-ded4d3350812 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:18.828484 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a819a-6146-4345-8d68-ded4d3350812 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:18.833366 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e502c-3b0b-45e7-b27b-179174b71f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:18.834019 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e502c-3b0b-45e7-b27b-179174b71f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:18.834296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e502c-3b0b-45e7-b27b-179174b71f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:18.834571 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e502c-3b0b-45e7-b27b-179174b71f52 admin admin] PATH_INFO: `/v3/projects/214eb5bd1e1942868c4c7f303eefefd8/users/27dc07fab8724bab9761f54ede616198/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:18.851526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e502c-3b0b-45e7-b27b-179174b71f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214eb5bd1e1942868c4c7f303eefefd8, user_id=27dc07fab8724bab9761f54ede616198, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:18.854254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e502c-3b0b-45e7-b27b-179174b71f52 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:18.944814 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1366/2726] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:18 2022] PUT /identity/v3/projects/214eb5bd1e1942868c4c7f303eefefd8/users/27dc07fab8724bab9761f54ede616198/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:18.956003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245c21-e0fa-4f25-a02b-b1876af63520 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:18.956356 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245c21-e0fa-4f25-a02b-b1876af63520 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:18.956629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245c21-e0fa-4f25-a02b-b1876af63520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:18.984532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-99245c21-e0fa-4f25-a02b-b1876af63520 None None] MFA Rules not processed for user `27dc07fab8724bab9761f54ede616198`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:18.985742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-99245c21-e0fa-4f25-a02b-b1876af63520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:19.049767 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1361/2727] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:19.054487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e502c-3b0b-45e7-b27b-179174b71f52 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:19.119146 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e502c-3b0b-45e7-b27b-179174b71f52 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:19.124008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fb05d-42c9-4734-9d42-a17b0b3ff8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:19.124610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fb05d-42c9-4734-9d42-a17b0b3ff8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:19.124889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fb05d-42c9-4734-9d42-a17b0b3ff8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:19.125194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fb05d-42c9-4734-9d42-a17b0b3ff8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:19.125822 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fb05d-42c9-4734-9d42-a17b0b3ff8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:19.127754 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fb05d-42c9-4734-9d42-a17b0b3ff8f9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:19.230523 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1367/2728] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:19 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:19.234754 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99245c21-e0fa-4f25-a02b-b1876af63520 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:19.245686 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99245c21-e0fa-4f25-a02b-b1876af63520 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:19.302044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3fe8-9428-4494-a5cf-8c659cba5511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:19.302642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3fe8-9428-4494-a5cf-8c659cba5511 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:19.302919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3fe8-9428-4494-a5cf-8c659cba5511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:19.303188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3fe8-9428-4494-a5cf-8c659cba5511 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:19.303803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf3fe8-9428-4494-a5cf-8c659cba5511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:19.305795 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf3fe8-9428-4494-a5cf-8c659cba5511 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:19.435496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1362/2729] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:19 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:19.439540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fb05d-42c9-4734-9d42-a17b0b3ff8f9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:19.450027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fb05d-42c9-4734-9d42-a17b0b3ff8f9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:19.454547 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81c12d-8128-4142-9675-3ded8ae36f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:19.455134 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81c12d-8128-4142-9675-3ded8ae36f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:19.455406 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81c12d-8128-4142-9675-3ded8ae36f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:19.455672 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81c12d-8128-4142-9675-3ded8ae36f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:19.456332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81c12d-8128-4142-9675-3ded8ae36f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:19.457908 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81c12d-8128-4142-9675-3ded8ae36f12 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:19.468713 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1368/2730] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:19.474138 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3fe8-9428-4494-a5cf-8c659cba5511 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:19.480442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:19.484095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3fe8-9428-4494-a5cf-8c659cba5511 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:19.488625 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49f76b-0360-4687-b771-cd1bb808b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:19.489263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49f76b-0360-4687-b771-cd1bb808b9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:19.489539 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49f76b-0360-4687-b771-cd1bb808b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:19.489809 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49f76b-0360-4687-b771-cd1bb808b9e5 admin admin] PATH_INFO: `/v3/projects/7c5b173ea47a4cd2bff09d2dc9b142ef/users/1031ce593639404f9a7a081b0140abb6/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:19.503973 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49f76b-0360-4687-b771-cd1bb808b9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5b173ea47a4cd2bff09d2dc9b142ef, user_id=1031ce593639404f9a7a081b0140abb6, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:19.509280 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49f76b-0360-4687-b771-cd1bb808b9e5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:19.644195 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1363/2731] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:19 2022] PUT /identity/v3/projects/7c5b173ea47a4cd2bff09d2dc9b142ef/users/1031ce593639404f9a7a081b0140abb6/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:19.648190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81c12d-8128-4142-9675-3ded8ae36f12 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:19.657939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81c12d-8128-4142-9675-3ded8ae36f12 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:19.714888 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70975471-327f-4a1a-a682-ba105ce4e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:19.715667 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975471-327f-4a1a-a682-ba105ce4e215 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:19.715925 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975471-327f-4a1a-a682-ba105ce4e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:19.721090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975471-327f-4a1a-a682-ba105ce4e215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:19.721090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70975471-327f-4a1a-a682-ba105ce4e215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:19.721090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70975471-327f-4a1a-a682-ba105ce4e215 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:19.729259 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1369/2732] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:19.733407 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49f76b-0360-4687-b771-cd1bb808b9e5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:19.744036 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49f76b-0360-4687-b771-cd1bb808b9e5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:19.749224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd770f20-3624-435d-a17b-468cbea89da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:19.749862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd770f20-3624-435d-a17b-468cbea89da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:19.750157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd770f20-3624-435d-a17b-468cbea89da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:19.750410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd770f20-3624-435d-a17b-468cbea89da4 admin admin] PATH_INFO: `/v3/projects/7c5b173ea47a4cd2bff09d2dc9b142ef/users/1031ce593639404f9a7a081b0140abb6/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:19.752383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd770f20-3624-435d-a17b-468cbea89da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5b173ea47a4cd2bff09d2dc9b142ef, user_id=1031ce593639404f9a7a081b0140abb6, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:19.755145 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd770f20-3624-435d-a17b-468cbea89da4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:19.766211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1364/2733] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:19 2022] PUT /identity/v3/projects/7c5b173ea47a4cd2bff09d2dc9b142ef/users/1031ce593639404f9a7a081b0140abb6/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:19.776229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd510-d1ef-4405-b43c-0a7aff358b47 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:19.776622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd510-d1ef-4405-b43c-0a7aff358b47 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:19.776874 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd510-d1ef-4405-b43c-0a7aff358b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:19.804529 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e4ccd510-d1ef-4405-b43c-0a7aff358b47 None None] MFA Rules not processed for user `1031ce593639404f9a7a081b0140abb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:19.805912 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e4ccd510-d1ef-4405-b43c-0a7aff358b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:19.818971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:19.875516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1370/2734] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:19.888891 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd770f20-3624-435d-a17b-468cbea89da4 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:19.890947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bd770f20-3624-435d-a17b-468cbea89da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:19.949543 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd770f20-3624-435d-a17b-468cbea89da4 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:19.953347 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fbfad-bb9c-44ac-a1b9-5636d5516006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:19.953943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fbfad-bb9c-44ac-a1b9-5636d5516006 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:19.954216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fbfad-bb9c-44ac-a1b9-5636d5516006 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:19.954483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fbfad-bb9c-44ac-a1b9-5636d5516006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:19.963364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fbfad-bb9c-44ac-a1b9-5636d5516006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:19.964818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fbfad-bb9c-44ac-a1b9-5636d5516006 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:19.974010 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1365/2735] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:21.013844 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccd510-d1ef-4405-b43c-0a7aff358b47 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:21.023454 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccd510-d1ef-4405-b43c-0a7aff358b47 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:21.028302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b38ce3-79e4-4f4a-932f-bac3595e3f61 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1031ce593639404f9a7a081b0140abb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c5b173ea47a4cd2bff09d2dc9b142ef', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:21.028890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38ce3-79e4-4f4a-932f-bac3595e3f61 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:21.029169 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38ce3-79e4-4f4a-932f-bac3595e3f61 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:21.029442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38ce3-79e4-4f4a-932f-bac3595e3f61 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:21.030076 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b38ce3-79e4-4f4a-932f-bac3595e3f61 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:42:21.030377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b38ce3-79e4-4f4a-932f-bac3595e3f61 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:21.031981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b38ce3-79e4-4f4a-932f-bac3595e3f61 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:21.043341 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1371/2736] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:42:21.047338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fbfad-bb9c-44ac-a1b9-5636d5516006 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:21.056243 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fbfad-bb9c-44ac-a1b9-5636d5516006 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:21.061301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19f72b-84d3-4e7e-a68f-d3130665711d tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1031ce593639404f9a7a081b0140abb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c5b173ea47a4cd2bff09d2dc9b142ef', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:21.061982 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19f72b-84d3-4e7e-a68f-d3130665711d tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:21.062161 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19f72b-84d3-4e7e-a68f-d3130665711d tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:21.062430 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19f72b-84d3-4e7e-a68f-d3130665711d tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:21.063057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19f72b-84d3-4e7e-a68f-d3130665711d tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:21.064988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19f72b-84d3-4e7e-a68f-d3130665711d tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:21.145916 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1366/2737] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:21 2022] POST /identity/v3/projects => generated 353 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:21.150148 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b38ce3-79e4-4f4a-932f-bac3595e3f61 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:21.159934 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b38ce3-79e4-4f4a-932f-bac3595e3f61 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:21.219289 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c29dc-7478-46d1-89b7-85afcf066078 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1031ce593639404f9a7a081b0140abb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c5b173ea47a4cd2bff09d2dc9b142ef', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:21.219937 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c29dc-7478-46d1-89b7-85afcf066078 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:21.220240 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c29dc-7478-46d1-89b7-85afcf066078 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:21.220584 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c29dc-7478-46d1-89b7-85afcf066078 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:21.221234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c29dc-7478-46d1-89b7-85afcf066078 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:42:21.221653 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c29dc-7478-46d1-89b7-85afcf066078 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:21.223167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c29dc-7478-46d1-89b7-85afcf066078 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:21.235313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1372/2738] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:42:21.282453 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19f72b-84d3-4e7e-a68f-d3130665711d tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:21.294131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19f72b-84d3-4e7e-a68f-d3130665711d tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:21.298960 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1031ce593639404f9a7a081b0140abb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c5b173ea47a4cd2bff09d2dc9b142ef', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:21.299588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:21.299870 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:21.300166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] PATH_INFO: `/v3/projects/bc2d59b0324848fc9854c0039ad6296e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:21.301285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bc2d59b0324848fc9854c0039ad6296e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:21.303184 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:21.404672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2d59b0324848fc9854c0039ad6296e', 'request_id': 'req-a772f9fc-5924-4218-baee-04ac52ac3868'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:21.410123 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2d59b0324848fc9854c0039ad6296e', 'request_id': 'req-a772f9fc-5924-4218-baee-04ac52ac3868'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:21.417116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2d59b0324848fc9854c0039ad6296e', 'request_id': 'req-a772f9fc-5924-4218-baee-04ac52ac3868'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:21.485969 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] The token cache is being invalidate because project bc2d59b0324848fc9854c0039ad6296e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:21.486186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:21.486808 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a772f9fc-5924-4218-baee-04ac52ac3868 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:21.488363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1367/2739] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:21 2022] DELETE /identity/v3/projects/bc2d59b0324848fc9854c0039ad6296e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:22.124241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c29dc-7478-46d1-89b7-85afcf066078 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:22.126010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e68c29dc-7478-46d1-89b7-85afcf066078 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:22.191355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c29dc-7478-46d1-89b7-85afcf066078 tempest-VolumeQuotaClassesTest-773021006 tempest-VolumeQuotaClassesTest-773021006-project-admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:22.228350 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:22.246159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:22.246811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:22.247110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:22.247380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] PATH_INFO: `/v3/users/27dc07fab8724bab9761f54ede616198` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:22.248558 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27dc07fab8724bab9761f54ede616198)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:22.250496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:22.471678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27dc07fab8724bab9761f54ede616198'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:22.523603 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27dc07fab8724bab9761f54ede616198'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:22.531434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27dc07fab8724bab9761f54ede616198'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:22.532105 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27dc07fab8724bab9761f54ede616198'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:22.544037 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27dc07fab8724bab9761f54ede616198'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:22.549830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1373/2740] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:22 2022] DELETE /identity/v3/users/27dc07fab8724bab9761f54ede616198 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:22.554421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b1ed7-169f-4b4f-8ebe-aaa9c7627147 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:22.554902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b1ed7-169f-4b4f-8ebe-aaa9c7627147 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:22.555000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b1ed7-169f-4b4f-8ebe-aaa9c7627147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:22.575418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ad6b1ed7-169f-4b4f-8ebe-aaa9c7627147 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:22.576639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ad6b1ed7-169f-4b4f-8ebe-aaa9c7627147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:22.601315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:22.634534 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1368/2741] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:42:22.645125 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:22.646651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:22.703364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc7a3d-e215-492d-9f1f-3e8c6be6e9c2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:22.707069 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f21ae7-345a-4999-8129-1f8bf5694c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:22.707669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f21ae7-345a-4999-8129-1f8bf5694c17 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:22.707988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f21ae7-345a-4999-8129-1f8bf5694c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:22.708264 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f21ae7-345a-4999-8129-1f8bf5694c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:22.717449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f21ae7-345a-4999-8129-1f8bf5694c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:22.718903 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f21ae7-345a-4999-8129-1f8bf5694c17 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:22.728418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1374/2742] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:23.154529 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b1ed7-169f-4b4f-8ebe-aaa9c7627147 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:23.155992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ad6b1ed7-169f-4b4f-8ebe-aaa9c7627147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:23.170189 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b1ed7-169f-4b4f-8ebe-aaa9c7627147 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:23.175458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:23.176288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:23.176564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:23.176910 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] PATH_INFO: `/v3/projects/214eb5bd1e1942868c4c7f303eefefd8` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:23.177942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=214eb5bd1e1942868c4c7f303eefefd8)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:23.179943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:23.288786 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214eb5bd1e1942868c4c7f303eefefd8', 'request_id': 'req-5b502cad-cd28-4733-9db3-70adc33a13ce'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:23.294250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214eb5bd1e1942868c4c7f303eefefd8', 'request_id': 'req-5b502cad-cd28-4733-9db3-70adc33a13ce'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:23.300204 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214eb5bd1e1942868c4c7f303eefefd8', 'request_id': 'req-5b502cad-cd28-4733-9db3-70adc33a13ce'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:23.390041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] The token cache is being invalidate because project 214eb5bd1e1942868c4c7f303eefefd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:23.390343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:23.391066 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:23.393094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1369/2743] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:23 2022] DELETE /identity/v3/projects/214eb5bd1e1942868c4c7f303eefefd8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:23.396987 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f21ae7-345a-4999-8129-1f8bf5694c17 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:23.406605 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f21ae7-345a-4999-8129-1f8bf5694c17 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:23.465510 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:23.466156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:23.466505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:23.466671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] PATH_INFO: `/v3/users/1031ce593639404f9a7a081b0140abb6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:23.467792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1031ce593639404f9a7a081b0140abb6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:23.469759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:23.472143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:23.646241 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1031ce593639404f9a7a081b0140abb6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:23.726505 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1031ce593639404f9a7a081b0140abb6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:23.734291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1031ce593639404f9a7a081b0140abb6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:23.734938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1031ce593639404f9a7a081b0140abb6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:23.747429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8dc120ad-6774-49da-b275-bb9b63548185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1031ce593639404f9a7a081b0140abb6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:23.753429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1375/2744] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:23 2022] DELETE /identity/v3/users/1031ce593639404f9a7a081b0140abb6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:24.194311 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:24.196132 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:24.211098 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502cad-cd28-4733-9db3-70adc33a13ce admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:24.277047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:24.277731 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:24.278099 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:24.278378 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] PATH_INFO: `/v3/projects/7c5b173ea47a4cd2bff09d2dc9b142ef` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:24.279612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5b173ea47a4cd2bff09d2dc9b142ef)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:24.281647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:24.408179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5b173ea47a4cd2bff09d2dc9b142ef', 'request_id': 'req-30c82d80-4b4d-4105-97ea-b5f7dd63f732'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:24.417439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:24.422560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5b173ea47a4cd2bff09d2dc9b142ef', 'request_id': 'req-30c82d80-4b4d-4105-97ea-b5f7dd63f732'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:24.428872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5b173ea47a4cd2bff09d2dc9b142ef', 'request_id': 'req-30c82d80-4b4d-4105-97ea-b5f7dd63f732'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:24.506410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] The token cache is being invalidate because project 7c5b173ea47a4cd2bff09d2dc9b142ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:24.506714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:24.507340 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-30c82d80-4b4d-4105-97ea-b5f7dd63f732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:24.508932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1370/2745] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:24 2022] DELETE /identity/v3/projects/7c5b173ea47a4cd2bff09d2dc9b142ef => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:24.514386 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec25d7f-50a5-4c9c-86bf-20d693bea50a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:24.515112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec25d7f-50a5-4c9c-86bf-20d693bea50a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:24.515212 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec25d7f-50a5-4c9c-86bf-20d693bea50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:24.538773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-fec25d7f-50a5-4c9c-86bf-20d693bea50a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:24.538773 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fec25d7f-50a5-4c9c-86bf-20d693bea50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:24.593716 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1376/2746] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:24.601584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebd591-a930-4730-9039-c9f0c3ad9391 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:24.601919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebd591-a930-4730-9039-c9f0c3ad9391 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:24.602199 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebd591-a930-4730-9039-c9f0c3ad9391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:24.621523 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3eebd591-a930-4730-9039-c9f0c3ad9391 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:24.622702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3eebd591-a930-4730-9039-c9f0c3ad9391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:24.630477 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1371/2747] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:24.634850 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec25d7f-50a5-4c9c-86bf-20d693bea50a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:24.645211 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec25d7f-50a5-4c9c-86bf-20d693bea50a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:24.649738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf86ef-9787-4c64-94b9-2f4b7d2ff70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:24.650322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf86ef-9787-4c64-94b9-2f4b7d2ff70a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:24.650592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf86ef-9787-4c64-94b9-2f4b7d2ff70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:24.651482 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf86ef-9787-4c64-94b9-2f4b7d2ff70a admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:24.652145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf86ef-9787-4c64-94b9-2f4b7d2ff70a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:42:24.652443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf86ef-9787-4c64-94b9-2f4b7d2ff70a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:24.654047 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf86ef-9787-4c64-94b9-2f4b7d2ff70a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:24.665188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1377/2748] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:42:24.669394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebd591-a930-4730-9039-c9f0c3ad9391 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:24.681945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebd591-a930-4730-9039-c9f0c3ad9391 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:24.683381 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488af59-4a7e-4df9-9e3d-5c438938179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:24.684008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488af59-4a7e-4df9-9e3d-5c438938179c admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:24.684283 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488af59-4a7e-4df9-9e3d-5c438938179c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:24.684550 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488af59-4a7e-4df9-9e3d-5c438938179c admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:24.685212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488af59-4a7e-4df9-9e3d-5c438938179c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:24.687110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488af59-4a7e-4df9-9e3d-5c438938179c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:24.793702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1372/2749] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:24 2022] POST /identity/v3/projects => generated 407 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:24.797853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf86ef-9787-4c64-94b9-2f4b7d2ff70a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:24.808229 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf86ef-9787-4c64-94b9-2f4b7d2ff70a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:24.868579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb9186-0072-4b18-824e-bb1c8c8a273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:24.869188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9186-0072-4b18-824e-bb1c8c8a273f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:24.869957 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9186-0072-4b18-824e-bb1c8c8a273f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:24.870665 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9186-0072-4b18-824e-bb1c8c8a273f admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:24.871023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb9186-0072-4b18-824e-bb1c8c8a273f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:24.873131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb9186-0072-4b18-824e-bb1c8c8a273f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:24.950364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:24.956329 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1378/2750] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:24 2022] POST /identity/v3/users => generated 304 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:24.960575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488af59-4a7e-4df9-9e3d-5c438938179c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:24.971061 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488af59-4a7e-4df9-9e3d-5c438938179c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:24.975821 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4cccc-ce60-4815-a0a8-1555acf69444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:24.976496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4cccc-ce60-4815-a0a8-1555acf69444 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:24.976773 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4cccc-ce60-4815-a0a8-1555acf69444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:24.977044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4cccc-ce60-4815-a0a8-1555acf69444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:24.977684 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4cccc-ce60-4815-a0a8-1555acf69444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:24.979358 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4cccc-ce60-4815-a0a8-1555acf69444 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:24.989598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1373/2751] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:42:24.993575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb9186-0072-4b18-824e-bb1c8c8a273f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:25.004618 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb9186-0072-4b18-824e-bb1c8c8a273f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:25.009468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889edd3-ab70-4740-9085-02998869fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:25.010098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889edd3-ab70-4740-9085-02998869fa5d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:25.010938 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889edd3-ab70-4740-9085-02998869fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:25.012982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889edd3-ab70-4740-9085-02998869fa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:25.012982 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889edd3-ab70-4740-9085-02998869fa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:25.013491 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889edd3-ab70-4740-9085-02998869fa5d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:25.025461 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1379/2752] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:25.029801 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4cccc-ce60-4815-a0a8-1555acf69444 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:25.040067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4cccc-ce60-4815-a0a8-1555acf69444 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:25.044733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf1d48-939d-4773-ac11-1342a603647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:25.045314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1d48-939d-4773-ac11-1342a603647a admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:25.045588 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1d48-939d-4773-ac11-1342a603647a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:25.045862 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1d48-939d-4773-ac11-1342a603647a admin admin] PATH_INFO: `/v3/projects/d1049831240f4f5abb01b2f4439102ff/users/1163e408637e44179f193296f96ddffe/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:25.060562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf1d48-939d-4773-ac11-1342a603647a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1049831240f4f5abb01b2f4439102ff, user_id=1163e408637e44179f193296f96ddffe, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:25.063191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf1d48-939d-4773-ac11-1342a603647a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:25.149384 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1374/2753] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:25 2022] PUT /identity/v3/projects/d1049831240f4f5abb01b2f4439102ff/users/1163e408637e44179f193296f96ddffe/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:25.161089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b0c4e-5b34-4930-878e-880ee4cdc744 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:25.161371 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b0c4e-5b34-4930-878e-880ee4cdc744 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:25.161698 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b0c4e-5b34-4930-878e-880ee4cdc744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:25.190640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-888b0c4e-5b34-4930-878e-880ee4cdc744 None None] MFA Rules not processed for user `1163e408637e44179f193296f96ddffe`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:25.191829 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-888b0c4e-5b34-4930-878e-880ee4cdc744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:25.253238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1380/2754] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:25 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:25.257780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf1d48-939d-4773-ac11-1342a603647a admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:25.321126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf1d48-939d-4773-ac11-1342a603647a admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:25.325811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda7885-50cf-46d5-a1fc-d033aad32e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:25.326408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda7885-50cf-46d5-a1fc-d033aad32e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:25.326681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda7885-50cf-46d5-a1fc-d033aad32e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:25.326954 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda7885-50cf-46d5-a1fc-d033aad32e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:25.327581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda7885-50cf-46d5-a1fc-d033aad32e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:25.329508 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda7885-50cf-46d5-a1fc-d033aad32e88 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:25.437224 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1375/2755] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:25 2022] POST /identity/v3/projects => generated 409 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:25.441318 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b0c4e-5b34-4930-878e-880ee4cdc744 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:25.452159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b0c4e-5b34-4930-878e-880ee4cdc744 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:25.507651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa482704-01dc-4d6a-9b85-677ab25b2122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:25.508286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa482704-01dc-4d6a-9b85-677ab25b2122 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:25.508561 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa482704-01dc-4d6a-9b85-677ab25b2122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:25.508831 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa482704-01dc-4d6a-9b85-677ab25b2122 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:25.509465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa482704-01dc-4d6a-9b85-677ab25b2122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:25.511383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa482704-01dc-4d6a-9b85-677ab25b2122 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:25.583099 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1381/2756] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:25 2022] POST /identity/v3/users => generated 311 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:25.587213 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda7885-50cf-46d5-a1fc-d033aad32e88 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:25.598186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda7885-50cf-46d5-a1fc-d033aad32e88 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:25.602880 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c51030-1e11-430b-9771-a49968c7fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:25.603475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c51030-1e11-430b-9771-a49968c7fce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:25.603750 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c51030-1e11-430b-9771-a49968c7fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:25.604811 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c51030-1e11-430b-9771-a49968c7fce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:25.605481 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c51030-1e11-430b-9771-a49968c7fce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:25.607110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c51030-1e11-430b-9771-a49968c7fce4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:25.618064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1376/2757] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:25.622119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa482704-01dc-4d6a-9b85-677ab25b2122 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:25.632041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa482704-01dc-4d6a-9b85-677ab25b2122 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:25.636549 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd5066-dcb7-4f5b-8ee5-31678286a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:25.637188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd5066-dcb7-4f5b-8ee5-31678286a90b admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:25.637464 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd5066-dcb7-4f5b-8ee5-31678286a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:25.639479 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd5066-dcb7-4f5b-8ee5-31678286a90b admin admin] PATH_INFO: `/v3/projects/c575d7908147440482c9969c37149e28/users/16914a846abb441a8a1318cfc588b095/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:25.652574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd5066-dcb7-4f5b-8ee5-31678286a90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c575d7908147440482c9969c37149e28, user_id=16914a846abb441a8a1318cfc588b095, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:25.655207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd5066-dcb7-4f5b-8ee5-31678286a90b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:25.732401 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1382/2758] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:25 2022] PUT /identity/v3/projects/c575d7908147440482c9969c37149e28/users/16914a846abb441a8a1318cfc588b095/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:25.736330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c51030-1e11-430b-9771-a49968c7fce4 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:25.746470 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c51030-1e11-430b-9771-a49968c7fce4 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:25.796899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:25.803355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8965c-0a99-4947-800f-2a2ac8fd944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:25.803962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8965c-0a99-4947-800f-2a2ac8fd944b admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:25.804244 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8965c-0a99-4947-800f-2a2ac8fd944b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:25.804514 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8965c-0a99-4947-800f-2a2ac8fd944b admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:25.805141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8965c-0a99-4947-800f-2a2ac8fd944b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:25.806742 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8965c-0a99-4947-800f-2a2ac8fd944b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:25.816380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1377/2759] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:25.820724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd5066-dcb7-4f5b-8ee5-31678286a90b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:25.831457 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd5066-dcb7-4f5b-8ee5-31678286a90b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:25.836542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cf8b3-aa34-4ad1-9cb2-46143b1d00b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:25.837191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cf8b3-aa34-4ad1-9cb2-46143b1d00b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:25.837465 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cf8b3-aa34-4ad1-9cb2-46143b1d00b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:25.837739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cf8b3-aa34-4ad1-9cb2-46143b1d00b1 admin admin] PATH_INFO: `/v3/projects/c575d7908147440482c9969c37149e28/users/16914a846abb441a8a1318cfc588b095/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:25.840332 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cf8b3-aa34-4ad1-9cb2-46143b1d00b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c575d7908147440482c9969c37149e28, user_id=16914a846abb441a8a1318cfc588b095, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:25.843067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cf8b3-aa34-4ad1-9cb2-46143b1d00b1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:25.853612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1383/2760] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:25 2022] PUT /identity/v3/projects/c575d7908147440482c9969c37149e28/users/16914a846abb441a8a1318cfc588b095/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:25.864643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c67bd-54af-4586-bc48-1f4df4bb8458 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:25.864964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c67bd-54af-4586-bc48-1f4df4bb8458 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:25.865237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c67bd-54af-4586-bc48-1f4df4bb8458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:25.892540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1c6c67bd-54af-4586-bc48-1f4df4bb8458 None None] MFA Rules not processed for user `16914a846abb441a8a1318cfc588b095`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:25.893770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1c6c67bd-54af-4586-bc48-1f4df4bb8458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:25.966136 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1378/2761] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:25 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:25.979062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cf8b3-aa34-4ad1-9cb2-46143b1d00b1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:25.979062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-725cf8b3-aa34-4ad1-9cb2-46143b1d00b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:26.009827 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:26.038758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cf8b3-aa34-4ad1-9cb2-46143b1d00b1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:26.042555 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7a67-7475-4581-970c-8aeaad45014a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:26.043159 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7a67-7475-4581-970c-8aeaad45014a service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:26.043434 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7a67-7475-4581-970c-8aeaad45014a service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:26.043703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7a67-7475-4581-970c-8aeaad45014a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:26.066654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e7a67-7475-4581-970c-8aeaad45014a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:26.066654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e7a67-7475-4581-970c-8aeaad45014a service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:26.066654 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1384/2762] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:25 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:26.387141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c67bd-54af-4586-bc48-1f4df4bb8458 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:26.397273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c67bd-54af-4586-bc48-1f4df4bb8458 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:26.401041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a6c92-df6e-4b75-afeb-92d6cf2da5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:26.402270 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a6c92-df6e-4b75-afeb-92d6cf2da5fe service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:26.402615 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a6c92-df6e-4b75-afeb-92d6cf2da5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:26.402894 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a6c92-df6e-4b75-afeb-92d6cf2da5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:26.459560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a6c92-df6e-4b75-afeb-92d6cf2da5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:26.461116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a6c92-df6e-4b75-afeb-92d6cf2da5fe service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:26.470386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1379/2763] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:26 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:33.416458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7a67-7475-4581-970c-8aeaad45014a service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:33.477780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7a67-7475-4581-970c-8aeaad45014a service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:33.482904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:33.483525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:33.483803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:33.484107 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] PATH_INFO: `/v3/users/1163e408637e44179f193296f96ddffe` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:33.485256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1163e408637e44179f193296f96ddffe)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:33.487158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:33.706688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1163e408637e44179f193296f96ddffe'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:33.828616 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1163e408637e44179f193296f96ddffe'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:33.836493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1163e408637e44179f193296f96ddffe'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:33.837220 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1163e408637e44179f193296f96ddffe'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:33.851535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1163e408637e44179f193296f96ddffe'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:33.858284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1385/2764] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:33 2022] DELETE /identity/v3/users/1163e408637e44179f193296f96ddffe => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:33.862775 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c10fb-d78f-4b92-a80b-e89dc16a7396 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:33.863263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c10fb-d78f-4b92-a80b-e89dc16a7396 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:33.863361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c10fb-d78f-4b92-a80b-e89dc16a7396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:33.882868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7f5c10fb-d78f-4b92-a80b-e89dc16a7396 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:33.884119 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7f5c10fb-d78f-4b92-a80b-e89dc16a7396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:33.943569 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1380/2765] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:33.953346 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:33.954853 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:34.016726 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8e454-74ae-4240-9631-347cebf4f296 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:34.020436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba761c-0007-44b8-85bc-099c025ccc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:34.021073 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba761c-0007-44b8-85bc-099c025ccc98 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:34.021354 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba761c-0007-44b8-85bc-099c025ccc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:34.021625 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba761c-0007-44b8-85bc-099c025ccc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:34.027572 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:34.031322 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba761c-0007-44b8-85bc-099c025ccc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:34.032819 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba761c-0007-44b8-85bc-099c025ccc98 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:34.042290 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1386/2766] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:34.453962 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c10fb-d78f-4b92-a80b-e89dc16a7396 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:34.456754 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7f5c10fb-d78f-4b92-a80b-e89dc16a7396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:34.468556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c10fb-d78f-4b92-a80b-e89dc16a7396 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:34.473410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:34.474240 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:34.474674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:34.475106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] PATH_INFO: `/v3/projects/d1049831240f4f5abb01b2f4439102ff` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:34.479705 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1049831240f4f5abb01b2f4439102ff)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:34.481921 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:34.494343 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:34.501493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba761c-0007-44b8-85bc-099c025ccc98 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:34.502955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4cba761c-0007-44b8-85bc-099c025ccc98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:34.516422 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba761c-0007-44b8-85bc-099c025ccc98 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:34.521059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:34.521740 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:34.522027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:34.522303 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] PATH_INFO: `/v3/users/f3217bf2bb434c10ba07e2c984820772` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:34.523436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3217bf2bb434c10ba07e2c984820772)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:34.525417 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:34.587504 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1049831240f4f5abb01b2f4439102ff', 'request_id': 'req-f017a8db-aea0-40e7-b9ce-59210523b934'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.592824 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1049831240f4f5abb01b2f4439102ff', 'request_id': 'req-f017a8db-aea0-40e7-b9ce-59210523b934'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.599229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1049831240f4f5abb01b2f4439102ff', 'request_id': 'req-f017a8db-aea0-40e7-b9ce-59210523b934'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.677506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] The token cache is being invalidate because project d1049831240f4f5abb01b2f4439102ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:34.677792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.678397 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.680009 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1381/2767] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:34 2022] DELETE /identity/v3/projects/d1049831240f4f5abb01b2f4439102ff => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:34.683703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:34.685558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:34.717111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3217bf2bb434c10ba07e2c984820772'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.748502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017a8db-aea0-40e7-b9ce-59210523b934 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:34.753126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:34.758225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:34.758225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:34.758225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] PATH_INFO: `/v3/users/16914a846abb441a8a1318cfc588b095` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:34.758225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=16914a846abb441a8a1318cfc588b095)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:34.758225 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:34.777697 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3217bf2bb434c10ba07e2c984820772'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.785154 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3217bf2bb434c10ba07e2c984820772'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.792751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3217bf2bb434c10ba07e2c984820772'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.798305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ee17f314-8ddb-4f69-88a1-3c07e8565723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3217bf2bb434c10ba07e2c984820772'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.804191 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1387/2768] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:34 2022] DELETE /identity/v3/users/f3217bf2bb434c10ba07e2c984820772 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:34.808578 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288a57c-dc1c-4d71-ac2b-3edce40a325c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:34.808861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288a57c-dc1c-4d71-ac2b-3edce40a325c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:34.809717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288a57c-dc1c-4d71-ac2b-3edce40a325c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:34.829091 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6288a57c-dc1c-4d71-ac2b-3edce40a325c None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:34.830405 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6288a57c-dc1c-4d71-ac2b-3edce40a325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:34.889685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1388/2769] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:42:34.899522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288a57c-dc1c-4d71-ac2b-3edce40a325c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:34.900848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6288a57c-dc1c-4d71-ac2b-3edce40a325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:34.944892 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16914a846abb441a8a1318cfc588b095'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.945560 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16914a846abb441a8a1318cfc588b095'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.957628 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16914a846abb441a8a1318cfc588b095'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.957818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288a57c-dc1c-4d71-ac2b-3edce40a325c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:34.961539 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e19e8-acaf-4e94-b0d7-e789a926760a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:34.962141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e19e8-acaf-4e94-b0d7-e789a926760a service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:34.962415 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e19e8-acaf-4e94-b0d7-e789a926760a service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:34.962687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e19e8-acaf-4e94-b0d7-e789a926760a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:34.964688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16914a846abb441a8a1318cfc588b095'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:34.971684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e19e8-acaf-4e94-b0d7-e789a926760a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:34.982639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e19e8-acaf-4e94-b0d7-e789a926760a service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:34.983265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1389/2770] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:42:35.026770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16914a846abb441a8a1318cfc588b095'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.033442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1382/2771] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:34 2022] DELETE /identity/v3/users/16914a846abb441a8a1318cfc588b095 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:35.414018 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e19e8-acaf-4e94-b0d7-e789a926760a service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:35.416846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-495e19e8-acaf-4e94-b0d7-e789a926760a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:35.429472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e19e8-acaf-4e94-b0d7-e789a926760a service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:35.438104 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:35.439679 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:35.443731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:35.465420 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:35.505953 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:35.506610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:35.506893 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:35.507165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] PATH_INFO: `/v3/projects/42f7ebf084ee4d0591b99c0118cf968f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:35.508325 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f7ebf084ee4d0591b99c0118cf968f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:35.510352 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:35.513606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26dcf5-2286-45a8-8fa7-ed4ce26ec0cb admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:35.518421 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:35.519052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:35.519330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:35.519600 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] PATH_INFO: `/v3/projects/c575d7908147440482c9969c37149e28` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:35.520954 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c575d7908147440482c9969c37149e28)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:35.522847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:35.639525 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f7ebf084ee4d0591b99c0118cf968f', 'request_id': 'req-d5c59b2b-5e85-4f88-9934-2fad18ce229b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.640160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c575d7908147440482c9969c37149e28', 'request_id': 'req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.645735 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f7ebf084ee4d0591b99c0118cf968f', 'request_id': 'req-d5c59b2b-5e85-4f88-9934-2fad18ce229b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.645891 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c575d7908147440482c9969c37149e28', 'request_id': 'req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.651870 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f7ebf084ee4d0591b99c0118cf968f', 'request_id': 'req-d5c59b2b-5e85-4f88-9934-2fad18ce229b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.652064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c575d7908147440482c9969c37149e28', 'request_id': 'req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.740809 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] The token cache is being invalidate because project 42f7ebf084ee4d0591b99c0118cf968f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:35.741095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.741730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.743295 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1390/2772] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:35 2022] DELETE /identity/v3/projects/42f7ebf084ee4d0591b99c0118cf968f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:35.747700 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:35.749008 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:35.812269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59b2b-5e85-4f88-9934-2fad18ce229b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:35.820745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] The token cache is being invalidate because project c575d7908147440482c9969c37149e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:35.821436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.824315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d33b0a3-75d4-4ec1-9f8d-85e3dec54878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:35.831182 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1383/2773] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:35 2022] DELETE /identity/v3/projects/c575d7908147440482c9969c37149e28 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:35.831182 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e3785-6ed7-4039-b5e7-e44c87e35ce5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:35.831182 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e3785-6ed7-4039-b5e7-e44c87e35ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:35.831490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e3785-6ed7-4039-b5e7-e44c87e35ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:35.853110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ab7e3785-6ed7-4039-b5e7-e44c87e35ce5 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:35.854436 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ab7e3785-6ed7-4039-b5e7-e44c87e35ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:35.857271 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:35.869541 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:35.871383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:35.871383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:35.871383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] PATH_INFO: `/v3/users/790d84372b5b41e4a0ff47d5697d60a5` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:35.872594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=790d84372b5b41e4a0ff47d5697d60a5)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:35.874651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:35.914736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1384/2774] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:42:35.924218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169d26f-031e-4235-9f05-7bd3fab787d2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:35.924500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169d26f-031e-4235-9f05-7bd3fab787d2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:35.924769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169d26f-031e-4235-9f05-7bd3fab787d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:35.945602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1169d26f-031e-4235-9f05-7bd3fab787d2 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:35.946781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1169d26f-031e-4235-9f05-7bd3fab787d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:35.954689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1385/2775] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:42:35.961259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169d26f-031e-4235-9f05-7bd3fab787d2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:35.967355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169d26f-031e-4235-9f05-7bd3fab787d2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:35.971833 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3f1ab-be9b-4800-a93b-0faff44c9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:35.972410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f1ab-be9b-4800-a93b-0faff44c9e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:35.972681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f1ab-be9b-4800-a93b-0faff44c9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:35.972947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f1ab-be9b-4800-a93b-0faff44c9e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:35.973564 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3f1ab-be9b-4800-a93b-0faff44c9e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:42:35.973859 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3f1ab-be9b-4800-a93b-0faff44c9e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:35.975424 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3f1ab-be9b-4800-a93b-0faff44c9e36 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:35.987913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1386/2776] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:42:35.994364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3f1ab-be9b-4800-a93b-0faff44c9e36 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:36.004410 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3f1ab-be9b-4800-a93b-0faff44c9e36 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:36.009275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e53704-2317-4caf-9daa-2601347a7e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:36.009840 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e53704-2317-4caf-9daa-2601347a7e6d admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.010115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e53704-2317-4caf-9daa-2601347a7e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.010411 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e53704-2317-4caf-9daa-2601347a7e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.011045 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e53704-2317-4caf-9daa-2601347a7e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:36.013020 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e53704-2317-4caf-9daa-2601347a7e6d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:36.074498 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790d84372b5b41e4a0ff47d5697d60a5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:36.093444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1387/2777] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:35 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:36.097522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e53704-2317-4caf-9daa-2601347a7e6d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:36.106487 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:36.149106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790d84372b5b41e4a0ff47d5697d60a5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:36.157020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790d84372b5b41e4a0ff47d5697d60a5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:36.157755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790d84372b5b41e4a0ff47d5697d60a5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:36.158554 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e53704-2317-4caf-9daa-2601347a7e6d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:36.163275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e677695-5cf2-4c62-b297-29df40424ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:36.163902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e677695-5cf2-4c62-b297-29df40424ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.164170 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e677695-5cf2-4c62-b297-29df40424ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.164439 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e677695-5cf2-4c62-b297-29df40424ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.165102 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e677695-5cf2-4c62-b297-29df40424ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:36.167023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e677695-5cf2-4c62-b297-29df40424ff2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:36.171452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790d84372b5b41e4a0ff47d5697d60a5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:36.177577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1391/2778] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:35 2022] DELETE /identity/v3/users/790d84372b5b41e4a0ff47d5697d60a5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:36.275391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1388/2779] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:36 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:36.280168 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:36.281545 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:36.344255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1fd9c-52cb-4086-9706-782286b3ee2e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:36.349025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1f482-fccc-4d16-bf00-96c5879b5560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:36.349659 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1f482-fccc-4d16-bf00-96c5879b5560 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.349941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1f482-fccc-4d16-bf00-96c5879b5560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.350213 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1f482-fccc-4d16-bf00-96c5879b5560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.350851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1f482-fccc-4d16-bf00-96c5879b5560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:36.352476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1f482-fccc-4d16-bf00-96c5879b5560 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:36.366452 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1392/2780] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:36.367669 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e677695-5cf2-4c62-b297-29df40424ff2 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:36.378115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e677695-5cf2-4c62-b297-29df40424ff2 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:36.384994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdaa95-b550-4698-a568-2f48352d39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:36.384994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdaa95-b550-4698-a568-2f48352d39b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.384994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdaa95-b550-4698-a568-2f48352d39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.384994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdaa95-b550-4698-a568-2f48352d39b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.385757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdaa95-b550-4698-a568-2f48352d39b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:36.387895 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdaa95-b550-4698-a568-2f48352d39b5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:36.400320 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1389/2781] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:36.404822 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1f482-fccc-4d16-bf00-96c5879b5560 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:36.414677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1f482-fccc-4d16-bf00-96c5879b5560 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:36.421217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca73f4-7064-4255-99b7-01e6fc7b547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:36.421217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca73f4-7064-4255-99b7-01e6fc7b547a admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.421217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca73f4-7064-4255-99b7-01e6fc7b547a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.421217 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca73f4-7064-4255-99b7-01e6fc7b547a admin admin] PATH_INFO: `/v3/projects/2a9238f2eb26432ea90d7c3665f49337/users/fd37b4a08c0043b4a8a54ff7dbd66f08/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.437167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca73f4-7064-4255-99b7-01e6fc7b547a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9238f2eb26432ea90d7c3665f49337, user_id=fd37b4a08c0043b4a8a54ff7dbd66f08, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:36.444415 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca73f4-7064-4255-99b7-01e6fc7b547a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:36.526780 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1393/2782] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:36 2022] PUT /identity/v3/projects/2a9238f2eb26432ea90d7c3665f49337/users/fd37b4a08c0043b4a8a54ff7dbd66f08/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:36.537538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc28d9-14e0-4627-8daa-000b0772b044 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.537819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc28d9-14e0-4627-8daa-000b0772b044 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.538090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc28d9-14e0-4627-8daa-000b0772b044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.565828 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-dddc28d9-14e0-4627-8daa-000b0772b044 None None] MFA Rules not processed for user `fd37b4a08c0043b4a8a54ff7dbd66f08`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:36.567028 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-dddc28d9-14e0-4627-8daa-000b0772b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:36.606688 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca73f4-7064-4255-99b7-01e6fc7b547a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:36.609302 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-86ca73f4-7064-4255-99b7-01e6fc7b547a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:36.642321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1390/2783] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:36.643022 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc28d9-14e0-4627-8daa-000b0772b044 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:36.659059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:36.682064 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca73f4-7064-4255-99b7-01e6fc7b547a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:36.686942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:36.687570 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.687848 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.688149 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] PATH_INFO: `/v3/projects/0042371985ae4284911a6670b94c4acc` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.689275 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0042371985ae4284911a6670b94c4acc)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:36.691291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:36.707563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc28d9-14e0-4627-8daa-000b0772b044 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:36.712212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14d670-573b-4ff3-98bd-a9ae7f044979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:36.712813 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14d670-573b-4ff3-98bd-a9ae7f044979 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.713093 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14d670-573b-4ff3-98bd-a9ae7f044979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.713370 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14d670-573b-4ff3-98bd-a9ae7f044979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.714120 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14d670-573b-4ff3-98bd-a9ae7f044979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:36.716728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14d670-573b-4ff3-98bd-a9ae7f044979 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:36.795427 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0042371985ae4284911a6670b94c4acc', 'request_id': 'req-a046cc51-20f9-4ec7-b7a7-a2713de3f127'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:36.800811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0042371985ae4284911a6670b94c4acc', 'request_id': 'req-a046cc51-20f9-4ec7-b7a7-a2713de3f127'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:36.807045 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0042371985ae4284911a6670b94c4acc', 'request_id': 'req-a046cc51-20f9-4ec7-b7a7-a2713de3f127'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:36.807939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:36.815110 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1391/2784] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:36 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:36.819212 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14d670-573b-4ff3-98bd-a9ae7f044979 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:36.882599 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14d670-573b-4ff3-98bd-a9ae7f044979 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:36.887987 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f085ae-3516-46f4-b94a-af5e77ffab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:36.888624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f085ae-3516-46f4-b94a-af5e77ffab0b admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.888902 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f085ae-3516-46f4-b94a-af5e77ffab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.889174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f085ae-3516-46f4-b94a-af5e77ffab0b admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.889799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f085ae-3516-46f4-b94a-af5e77ffab0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:36.892015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f085ae-3516-46f4-b94a-af5e77ffab0b admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:36.912218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] The token cache is being invalidate because project 0042371985ae4284911a6670b94c4acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:36.916164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:36.916164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a046cc51-20f9-4ec7-b7a7-a2713de3f127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:36.916164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1394/2785] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:36 2022] DELETE /identity/v3/projects/0042371985ae4284911a6670b94c4acc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:36.919575 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac48b5e-7527-4919-aead-068d42e45a61 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.919851 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac48b5e-7527-4919-aead-068d42e45a61 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.920143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac48b5e-7527-4919-aead-068d42e45a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.939559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6ac48b5e-7527-4919-aead-068d42e45a61 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:36.940755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6ac48b5e-7527-4919-aead-068d42e45a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:36.948567 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1395/2786] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:42:36.956594 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f2793-62b9-4aa1-9d4f-e09d0902ba1b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:36.956877 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f2793-62b9-4aa1-9d4f-e09d0902ba1b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:36.957151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f2793-62b9-4aa1-9d4f-e09d0902ba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:36.975402 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b44f2793-62b9-4aa1-9d4f-e09d0902ba1b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:36.976581 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b44f2793-62b9-4aa1-9d4f-e09d0902ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:36.984429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1396/2787] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:42:36.988444 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f2793-62b9-4aa1-9d4f-e09d0902ba1b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:36.997439 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f2793-62b9-4aa1-9d4f-e09d0902ba1b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.001951 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350d5fa-4058-4976-a095-4b20e618d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.002533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d5fa-4058-4976-a095-4b20e618d55a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.002807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d5fa-4058-4976-a095-4b20e618d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.003072 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d5fa-4058-4976-a095-4b20e618d55a admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.003682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350d5fa-4058-4976-a095-4b20e618d55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:42:37.004014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350d5fa-4058-4976-a095-4b20e618d55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.005564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350d5fa-4058-4976-a095-4b20e618d55a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.017476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1397/2788] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:42:37.021623 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350d5fa-4058-4976-a095-4b20e618d55a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.022100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1392/2789] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:36 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:37.025772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f085ae-3516-46f4-b94a-af5e77ffab0b admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.027336 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-44f085ae-3516-46f4-b94a-af5e77ffab0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:37.033415 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350d5fa-4058-4976-a095-4b20e618d55a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.038150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952acef-94d9-4bde-9b25-d082ac3565d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.038739 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952acef-94d9-4bde-9b25-d082ac3565d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.039015 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952acef-94d9-4bde-9b25-d082ac3565d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.039284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952acef-94d9-4bde-9b25-d082ac3565d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.040036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952acef-94d9-4bde-9b25-d082ac3565d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.040940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f085ae-3516-46f4-b94a-af5e77ffab0b admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.041816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952acef-94d9-4bde-9b25-d082ac3565d6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.045798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d4f88-8995-460d-b928-9aeb84a17de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.046418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d4f88-8995-460d-b928-9aeb84a17de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.046693 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d4f88-8995-460d-b928-9aeb84a17de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.046964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d4f88-8995-460d-b928-9aeb84a17de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.047610 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d4f88-8995-460d-b928-9aeb84a17de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.049239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d4f88-8995-460d-b928-9aeb84a17de4 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.059717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1393/2790] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:42:37.063743 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d4f88-8995-460d-b928-9aeb84a17de4 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.073135 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d4f88-8995-460d-b928-9aeb84a17de4 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.078290 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9bf0-b9c4-4cd3-b448-0d63a7095055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.078899 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9bf0-b9c4-4cd3-b448-0d63a7095055 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.079174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9bf0-b9c4-4cd3-b448-0d63a7095055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.079447 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9bf0-b9c4-4cd3-b448-0d63a7095055 admin admin] PATH_INFO: `/v3/projects/12cdfb45da7e4568a24790a5786199d2/users/5df557325fa145cbbf60e9b24e8df205/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.093575 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f9bf0-b9c4-4cd3-b448-0d63a7095055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cdfb45da7e4568a24790a5786199d2, user_id=5df557325fa145cbbf60e9b24e8df205, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.096216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f9bf0-b9c4-4cd3-b448-0d63a7095055 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.122511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1398/2791] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:37 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:37.126451 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952acef-94d9-4bde-9b25-d082ac3565d6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.195695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1394/2792] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:37 2022] PUT /identity/v3/projects/12cdfb45da7e4568a24790a5786199d2/users/5df557325fa145cbbf60e9b24e8df205/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:37.199854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9bf0-b9c4-4cd3-b448-0d63a7095055 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.205583 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952acef-94d9-4bde-9b25-d082ac3565d6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.230398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:37.267595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf66b79-c1a7-4ea6-90cf-987f7451b961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.268222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf66b79-c1a7-4ea6-90cf-987f7451b961 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.268674 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf66b79-c1a7-4ea6-90cf-987f7451b961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.268949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf66b79-c1a7-4ea6-90cf-987f7451b961 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.272553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf66b79-c1a7-4ea6-90cf-987f7451b961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.274862 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf66b79-c1a7-4ea6-90cf-987f7451b961 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.277500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9bf0-b9c4-4cd3-b448-0d63a7095055 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.283303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f4454-ccfe-4440-8949-07b53724ae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.284237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f4454-ccfe-4440-8949-07b53724ae6e admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.284687 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f4454-ccfe-4440-8949-07b53724ae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.285126 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f4454-ccfe-4440-8949-07b53724ae6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.285988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f4454-ccfe-4440-8949-07b53724ae6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.288012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f4454-ccfe-4440-8949-07b53724ae6e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.299401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1395/2793] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:42:37.303582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f4454-ccfe-4440-8949-07b53724ae6e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.313913 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f4454-ccfe-4440-8949-07b53724ae6e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.319008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a3c16-62c3-48c0-9a7b-7f5558ba8a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.325051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a3c16-62c3-48c0-9a7b-7f5558ba8a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.325051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a3c16-62c3-48c0-9a7b-7f5558ba8a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.325051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a3c16-62c3-48c0-9a7b-7f5558ba8a4f admin admin] PATH_INFO: `/v3/projects/12cdfb45da7e4568a24790a5786199d2/users/5df557325fa145cbbf60e9b24e8df205/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.325051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a3c16-62c3-48c0-9a7b-7f5558ba8a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cdfb45da7e4568a24790a5786199d2, user_id=5df557325fa145cbbf60e9b24e8df205, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.325051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a3c16-62c3-48c0-9a7b-7f5558ba8a4f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.335395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1396/2794] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:37 2022] PUT /identity/v3/projects/12cdfb45da7e4568a24790a5786199d2/users/5df557325fa145cbbf60e9b24e8df205/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:37.345655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551eaca-844d-459f-b0b2-94c74719dbbd None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.345972 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551eaca-844d-459f-b0b2-94c74719dbbd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.346251 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551eaca-844d-459f-b0b2-94c74719dbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.374930 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c551eaca-844d-459f-b0b2-94c74719dbbd None None] MFA Rules not processed for user `5df557325fa145cbbf60e9b24e8df205`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:37.376220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c551eaca-844d-459f-b0b2-94c74719dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:37.403710 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:37.405115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1399/2795] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:37 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:37.409940 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf66b79-c1a7-4ea6-90cf-987f7451b961 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.420753 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf66b79-c1a7-4ea6-90cf-987f7451b961 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.452520 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1397/2796] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:42:37.463416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551eaca-844d-459f-b0b2-94c74719dbbd None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.466011 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c551eaca-844d-459f-b0b2-94c74719dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:37.477040 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7f811-7a1e-4db2-97f1-ab99a9796571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.477627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7f811-7a1e-4db2-97f1-ab99a9796571 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.477902 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7f811-7a1e-4db2-97f1-ab99a9796571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.478167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7f811-7a1e-4db2-97f1-ab99a9796571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.478799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7f811-7a1e-4db2-97f1-ab99a9796571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.480424 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7f811-7a1e-4db2-97f1-ab99a9796571 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.491330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1400/2797] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:42:37.495218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7f811-7a1e-4db2-97f1-ab99a9796571 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.505361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7f811-7a1e-4db2-97f1-ab99a9796571 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.510388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7cc44-8357-4dd3-811a-d0dd65ea3334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.511001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7cc44-8357-4dd3-811a-d0dd65ea3334 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.511287 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7cc44-8357-4dd3-811a-d0dd65ea3334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.511560 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7cc44-8357-4dd3-811a-d0dd65ea3334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.512286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7cc44-8357-4dd3-811a-d0dd65ea3334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.514043 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7cc44-8357-4dd3-811a-d0dd65ea3334 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.524404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1401/2798] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:42:37.526458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551eaca-844d-459f-b0b2-94c74719dbbd None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.528945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7cc44-8357-4dd3-811a-d0dd65ea3334 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.531134 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc3b27-d7ef-49fd-a010-8a85dff9696a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.531741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3b27-d7ef-49fd-a010-8a85dff9696a service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.532095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3b27-d7ef-49fd-a010-8a85dff9696a service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.532366 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3b27-d7ef-49fd-a010-8a85dff9696a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.538409 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7cc44-8357-4dd3-811a-d0dd65ea3334 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.541474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc3b27-d7ef-49fd-a010-8a85dff9696a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.542896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc3b27-d7ef-49fd-a010-8a85dff9696a service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.543160 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23155b31-0378-4e3c-9ed9-6f440d9c4187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.544396 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23155b31-0378-4e3c-9ed9-6f440d9c4187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.544675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23155b31-0378-4e3c-9ed9-6f440d9c4187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.544945 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23155b31-0378-4e3c-9ed9-6f440d9c4187 admin admin] PATH_INFO: `/v3/projects/3d54d00f8b49410ca45a2385b004945c/users/84d7fbc3a1594df993784952887d5c22/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.554361 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1398/2799] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:42:37.560150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23155b31-0378-4e3c-9ed9-6f440d9c4187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d54d00f8b49410ca45a2385b004945c, user_id=84d7fbc3a1594df993784952887d5c22, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.562843 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23155b31-0378-4e3c-9ed9-6f440d9c4187 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.632042 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1402/2800] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:37 2022] PUT /identity/v3/projects/3d54d00f8b49410ca45a2385b004945c/users/84d7fbc3a1594df993784952887d5c22/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:37.642655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ea79-ade1-4610-8e71-070faac23901 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.642939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ea79-ade1-4610-8e71-070faac23901 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.643265 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ea79-ade1-4610-8e71-070faac23901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.679334 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5794ea79-ade1-4610-8e71-070faac23901 None None] MFA Rules not processed for user `84d7fbc3a1594df993784952887d5c22`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:37.680589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5794ea79-ade1-4610-8e71-070faac23901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:37.760259 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1399/2801] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:37.763972 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23155b31-0378-4e3c-9ed9-6f440d9c4187 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.844110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23155b31-0378-4e3c-9ed9-6f440d9c4187 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:37.849106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508faacd-d66d-4b7d-96fb-d75f8fe0b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:37.849715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508faacd-d66d-4b7d-96fb-d75f8fe0b9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:37.849993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508faacd-d66d-4b7d-96fb-d75f8fe0b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:37.850266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508faacd-d66d-4b7d-96fb-d75f8fe0b9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:37.850942 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508faacd-d66d-4b7d-96fb-d75f8fe0b9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:37.852861 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508faacd-d66d-4b7d-96fb-d75f8fe0b9b4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:37.949449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1403/2802] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:37 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:37.951068 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794ea79-ade1-4610-8e71-070faac23901 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:37.970446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794ea79-ade1-4610-8e71-070faac23901 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:38.018037 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:38.024901 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d5002-7902-47eb-bb0d-b7f8aa48db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:38.025517 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d5002-7902-47eb-bb0d-b7f8aa48db65 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.025780 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d5002-7902-47eb-bb0d-b7f8aa48db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.026054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d5002-7902-47eb-bb0d-b7f8aa48db65 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.026694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d5002-7902-47eb-bb0d-b7f8aa48db65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:38.029307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d5002-7902-47eb-bb0d-b7f8aa48db65 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:38.110685 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508faacd-d66d-4b7d-96fb-d75f8fe0b9b4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:38.116099 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:38.121826 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508faacd-d66d-4b7d-96fb-d75f8fe0b9b4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:38.125269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1400/2803] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:37 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:38.128258 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:38.128881 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.129763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.129763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] PATH_INFO: `/v3/users/fd37b4a08c0043b4a8a54ff7dbd66f08` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.130666 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd37b4a08c0043b4a8a54ff7dbd66f08)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:38.132402 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d5002-7902-47eb-bb0d-b7f8aa48db65 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:38.132620 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:38.143152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d5002-7902-47eb-bb0d-b7f8aa48db65 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:38.147840 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed4d4c-18e1-40b8-b1ee-b36e69d8c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:38.148466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed4d4c-18e1-40b8-b1ee-b36e69d8c923 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.148741 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed4d4c-18e1-40b8-b1ee-b36e69d8c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.149012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed4d4c-18e1-40b8-b1ee-b36e69d8c923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.149643 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed4d4c-18e1-40b8-b1ee-b36e69d8c923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:38.151230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed4d4c-18e1-40b8-b1ee-b36e69d8c923 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:38.161956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1401/2804] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:42:38.165896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed4d4c-18e1-40b8-b1ee-b36e69d8c923 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:38.175389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed4d4c-18e1-40b8-b1ee-b36e69d8c923 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:38.180500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dc55e-b11b-45d4-8d35-5cb9cde1692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:38.181051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dc55e-b11b-45d4-8d35-5cb9cde1692c admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.181473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dc55e-b11b-45d4-8d35-5cb9cde1692c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.181746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dc55e-b11b-45d4-8d35-5cb9cde1692c admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.182354 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dc55e-b11b-45d4-8d35-5cb9cde1692c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:38.183957 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dc55e-b11b-45d4-8d35-5cb9cde1692c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:38.194254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1402/2805] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:42:38.198604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dc55e-b11b-45d4-8d35-5cb9cde1692c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:38.208191 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dc55e-b11b-45d4-8d35-5cb9cde1692c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:38.212783 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c26ee-28b3-498c-bd5d-89fe8322b421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:38.213375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c26ee-28b3-498c-bd5d-89fe8322b421 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.213678 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c26ee-28b3-498c-bd5d-89fe8322b421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.213947 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c26ee-28b3-498c-bd5d-89fe8322b421 admin admin] PATH_INFO: `/v3/projects/63a8d9f39637433e8d73bd4461660513/users/e98d0ee0d70c431396c6f3adab401f9b/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.232854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c26ee-28b3-498c-bd5d-89fe8322b421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a8d9f39637433e8d73bd4461660513, user_id=e98d0ee0d70c431396c6f3adab401f9b, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:38.232854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c26ee-28b3-498c-bd5d-89fe8322b421 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:38.323736 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd37b4a08c0043b4a8a54ff7dbd66f08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:38.373015 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1403/2806] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:38 2022] PUT /identity/v3/projects/63a8d9f39637433e8d73bd4461660513/users/e98d0ee0d70c431396c6f3adab401f9b/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:38.395694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd37b4a08c0043b4a8a54ff7dbd66f08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:38.404027 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd37b4a08c0043b4a8a54ff7dbd66f08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:38.404784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd37b4a08c0043b4a8a54ff7dbd66f08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:38.419098 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fa218836-8398-4b06-823f-471c0e9959c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd37b4a08c0043b4a8a54ff7dbd66f08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:38.425803 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1404/2807] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:38 2022] DELETE /identity/v3/users/fd37b4a08c0043b4a8a54ff7dbd66f08 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:38.430655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885be5e-76e9-4066-8d01-ca93719bf741 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.430938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885be5e-76e9-4066-8d01-ca93719bf741 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.431211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885be5e-76e9-4066-8d01-ca93719bf741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.441550 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a8212-e18f-4de9-bf2d-e65f3c21cceb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.441815 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a8212-e18f-4de9-bf2d-e65f3c21cceb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.442119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a8212-e18f-4de9-bf2d-e65f3c21cceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.454057 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3885be5e-76e9-4066-8d01-ca93719bf741 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:38.456048 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3885be5e-76e9-4066-8d01-ca93719bf741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:38.481891 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a29a8212-e18f-4de9-bf2d-e65f3c21cceb None None] MFA Rules not processed for user `e98d0ee0d70c431396c6f3adab401f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:38.483297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a29a8212-e18f-4de9-bf2d-e65f3c21cceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:38.523932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1404/2808] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:38.533745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885be5e-76e9-4066-8d01-ca93719bf741 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:38.535074 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3885be5e-76e9-4066-8d01-ca93719bf741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:38.546103 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1405/2809] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:42:38.550514 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a8212-e18f-4de9-bf2d-e65f3c21cceb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:38.551919 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a29a8212-e18f-4de9-bf2d-e65f3c21cceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:38.565521 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a8212-e18f-4de9-bf2d-e65f3c21cceb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:38.570460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376699f-7e3f-42a4-90bb-0f9eb9428b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:38.571052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376699f-7e3f-42a4-90bb-0f9eb9428b5c admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.571326 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376699f-7e3f-42a4-90bb-0f9eb9428b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.571595 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376699f-7e3f-42a4-90bb-0f9eb9428b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.572247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376699f-7e3f-42a4-90bb-0f9eb9428b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:38.574144 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376699f-7e3f-42a4-90bb-0f9eb9428b5c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:38.592258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885be5e-76e9-4066-8d01-ca93719bf741 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:38.595919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12620997-a888-40ff-b180-4f7640b675c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:38.596546 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12620997-a888-40ff-b180-4f7640b675c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.596819 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12620997-a888-40ff-b180-4f7640b675c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.597085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12620997-a888-40ff-b180-4f7640b675c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.606178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12620997-a888-40ff-b180-4f7640b675c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:38.607663 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12620997-a888-40ff-b180-4f7640b675c2 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:38.616905 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1405/2810] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:42:38.694413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1406/2811] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:38 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:38.698647 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12620997-a888-40ff-b180-4f7640b675c2 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:38.708392 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12620997-a888-40ff-b180-4f7640b675c2 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:38.748649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:38.764801 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69860-a347-4c5c-828c-5b6b07122453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:38.765401 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69860-a347-4c5c-828c-5b6b07122453 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.765935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69860-a347-4c5c-828c-5b6b07122453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.766201 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69860-a347-4c5c-828c-5b6b07122453 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.766823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a69860-a347-4c5c-828c-5b6b07122453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:38.768768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a69860-a347-4c5c-828c-5b6b07122453 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:38.942799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1406/2812] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:38 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:38.946916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376699f-7e3f-42a4-90bb-0f9eb9428b5c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:38.957153 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376699f-7e3f-42a4-90bb-0f9eb9428b5c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:38.961661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f5b9-7669-4840-9023-fc619282b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:38.962257 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f5b9-7669-4840-9023-fc619282b497 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.962532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f5b9-7669-4840-9023-fc619282b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.962857 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f5b9-7669-4840-9023-fc619282b497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:38.965242 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727f5b9-7669-4840-9023-fc619282b497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:38.966830 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727f5b9-7669-4840-9023-fc619282b497 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:38.976767 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1407/2813] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:38.981373 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69860-a347-4c5c-828c-5b6b07122453 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:38.991237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69860-a347-4c5c-828c-5b6b07122453 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:38.996048 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedc6d0-c4ab-4300-88a9-28c46d514319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:38.997368 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedc6d0-c4ab-4300-88a9-28c46d514319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:38.997646 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedc6d0-c4ab-4300-88a9-28c46d514319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:38.997943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedc6d0-c4ab-4300-88a9-28c46d514319 admin admin] PATH_INFO: `/v3/projects/a19728bf000c43e58a40af6d72ee69d2/users/ca8f958073f04933829ec8ab0accbd04/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:39.012847 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedc6d0-c4ab-4300-88a9-28c46d514319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19728bf000c43e58a40af6d72ee69d2, user_id=ca8f958073f04933829ec8ab0accbd04, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:39.015763 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedc6d0-c4ab-4300-88a9-28c46d514319 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:39.033892 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f5b9-7669-4840-9023-fc619282b497 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:39.035644 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6727f5b9-7669-4840-9023-fc619282b497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:39.049297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f5b9-7669-4840-9023-fc619282b497 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:39.056078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:39.056078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:39.056078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:39.056781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] PATH_INFO: `/v3/projects/2a9238f2eb26432ea90d7c3665f49337` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:39.057249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9238f2eb26432ea90d7c3665f49337)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:39.059163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:39.107628 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1407/2814] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:38 2022] PUT /identity/v3/projects/a19728bf000c43e58a40af6d72ee69d2/users/ca8f958073f04933829ec8ab0accbd04/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:39.111542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedc6d0-c4ab-4300-88a9-28c46d514319 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:39.154860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:39.171487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9238f2eb26432ea90d7c3665f49337', 'request_id': 'req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:39.173402 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedc6d0-c4ab-4300-88a9-28c46d514319 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:39.177183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9238f2eb26432ea90d7c3665f49337', 'request_id': 'req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:39.184165 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9238f2eb26432ea90d7c3665f49337', 'request_id': 'req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:39.230055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cc0e0-0376-4ede-b203-ab06510521aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:39.230665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc0e0-0376-4ede-b203-ab06510521aa admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:39.231544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc0e0-0376-4ede-b203-ab06510521aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:39.231851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc0e0-0376-4ede-b203-ab06510521aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:39.232495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cc0e0-0376-4ede-b203-ab06510521aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:39.234095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cc0e0-0376-4ede-b203-ab06510521aa admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:39.243688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1408/2815] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:42:39.247662 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cc0e0-0376-4ede-b203-ab06510521aa admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:39.257088 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cc0e0-0376-4ede-b203-ab06510521aa admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:39.261035 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] The token cache is being invalidate because project 2a9238f2eb26432ea90d7c3665f49337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:39.261259 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:39.261771 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab89de9-c2a2-403e-8c1a-47207085e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:39.261912 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:39.265997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab89de9-c2a2-403e-8c1a-47207085e09c admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:39.265997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab89de9-c2a2-403e-8c1a-47207085e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:39.265997 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab89de9-c2a2-403e-8c1a-47207085e09c admin admin] PATH_INFO: `/v3/projects/a19728bf000c43e58a40af6d72ee69d2/users/ca8f958073f04933829ec8ab0accbd04/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:39.266291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1408/2816] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:39 2022] DELETE /identity/v3/projects/2a9238f2eb26432ea90d7c3665f49337 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:39.266385 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab89de9-c2a2-403e-8c1a-47207085e09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19728bf000c43e58a40af6d72ee69d2, user_id=ca8f958073f04933829ec8ab0accbd04, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:39.268130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab89de9-c2a2-403e-8c1a-47207085e09c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:39.268254 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:39.269502 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:39.279234 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1409/2817] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:39 2022] PUT /identity/v3/projects/a19728bf000c43e58a40af6d72ee69d2/users/ca8f958073f04933829ec8ab0accbd04/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:39.290138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb3501-cf50-42c9-a3c9-c9c41b0adc77 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:39.291732 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d74e2-da24-4854-a3a9-25a6a645f243 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:39.292039 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d74e2-da24-4854-a3a9-25a6a645f243 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:39.292322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d74e2-da24-4854-a3a9-25a6a645f243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:39.320983 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2c5d74e2-da24-4854-a3a9-25a6a645f243 None None] MFA Rules not processed for user `ca8f958073f04933829ec8ab0accbd04`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:39.322202 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2c5d74e2-da24-4854-a3a9-25a6a645f243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:39.339852 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:39.341001 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:39.341277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:39.341542 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] PATH_INFO: `/v3/users/5df557325fa145cbbf60e9b24e8df205` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:39.342725 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df557325fa145cbbf60e9b24e8df205)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:39.344668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:39.349466 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:39.391584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1410/2818] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:39.403506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d74e2-da24-4854-a3a9-25a6a645f243 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:39.404859 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2c5d74e2-da24-4854-a3a9-25a6a645f243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:39.459515 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d74e2-da24-4854-a3a9-25a6a645f243 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:39.463146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047855c-aa61-409f-af08-baa3d74a7036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:39.463744 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047855c-aa61-409f-af08-baa3d74a7036 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:39.464056 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047855c-aa61-409f-af08-baa3d74a7036 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:39.464329 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047855c-aa61-409f-af08-baa3d74a7036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:39.473694 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047855c-aa61-409f-af08-baa3d74a7036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:39.475141 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047855c-aa61-409f-af08-baa3d74a7036 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:39.484389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1411/2819] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:42:39.589986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df557325fa145cbbf60e9b24e8df205'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:39.595632 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047855c-aa61-409f-af08-baa3d74a7036 service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:39.597116 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9047855c-aa61-409f-af08-baa3d74a7036 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:39.608391 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047855c-aa61-409f-af08-baa3d74a7036 service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:39.612084 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb1800-35d2-4bda-a076-efa7ff90ca8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:39.612682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb1800-35d2-4bda-a076-efa7ff90ca8e service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:39.612956 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb1800-35d2-4bda-a076-efa7ff90ca8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:39.613228 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb1800-35d2-4bda-a076-efa7ff90ca8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:39.615107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-81bb1800-35d2-4bda-a076-efa7ff90ca8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:39.672905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df557325fa145cbbf60e9b24e8df205'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:39.676886 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb1800-35d2-4bda-a076-efa7ff90ca8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:39.678332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb1800-35d2-4bda-a076-efa7ff90ca8e service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:39.680553 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df557325fa145cbbf60e9b24e8df205'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:39.689730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df557325fa145cbbf60e9b24e8df205'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:39.689896 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1412/2820] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:42:39.695190 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a24aec6c-227b-4c70-a677-5a93ac48d750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df557325fa145cbbf60e9b24e8df205'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:39.701799 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1409/2821] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:39 2022] DELETE /identity/v3/users/5df557325fa145cbbf60e9b24e8df205 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:42:40.120248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb1800-35d2-4bda-a076-efa7ff90ca8e service cinder] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:40.131723 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb1800-35d2-4bda-a076-efa7ff90ca8e service cinder] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:40.191531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:40.192521 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:40.192981 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:40.193247 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] PATH_INFO: `/v3/projects/12cdfb45da7e4568a24790a5786199d2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:40.194372 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12cdfb45da7e4568a24790a5786199d2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:40.196322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:40.203209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:40.318745 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12cdfb45da7e4568a24790a5786199d2', 'request_id': 'req-f16d5828-c38f-4adb-9170-d0e448f95b68'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:40.324137 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12cdfb45da7e4568a24790a5786199d2', 'request_id': 'req-f16d5828-c38f-4adb-9170-d0e448f95b68'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:40.331169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12cdfb45da7e4568a24790a5786199d2', 'request_id': 'req-f16d5828-c38f-4adb-9170-d0e448f95b68'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:40.421393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] The token cache is being invalidate because project 12cdfb45da7e4568a24790a5786199d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:40.421601 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:40.422220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-f16d5828-c38f-4adb-9170-d0e448f95b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:40.427850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1413/2822] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:40 2022] DELETE /identity/v3/projects/12cdfb45da7e4568a24790a5786199d2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:40.429777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7233-14ed-4399-b9ca-1b5b2ac199b6 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:40.429777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7233-14ed-4399-b9ca-1b5b2ac199b6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:40.430151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7233-14ed-4399-b9ca-1b5b2ac199b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:40.456383 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a77b7233-14ed-4399-b9ca-1b5b2ac199b6 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:40.458228 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a77b7233-14ed-4399-b9ca-1b5b2ac199b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:40.486763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:40.517610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1410/2823] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:42:40.581090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e903-020b-490a-8fc0-6c7074de1539 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:40.581379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e903-020b-490a-8fc0-6c7074de1539 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:40.581651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e903-020b-490a-8fc0-6c7074de1539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:40.601446 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-fcd5e903-020b-490a-8fc0-6c7074de1539 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:40.602655 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fcd5e903-020b-490a-8fc0-6c7074de1539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:40.610695 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1414/2824] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:40.614860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7233-14ed-4399-b9ca-1b5b2ac199b6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:40.624846 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7233-14ed-4399-b9ca-1b5b2ac199b6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:40.629373 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886803e-8728-44c7-9b23-a33946ba69f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:40.629963 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886803e-8728-44c7-9b23-a33946ba69f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:40.630238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886803e-8728-44c7-9b23-a33946ba69f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:40.630513 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886803e-8728-44c7-9b23-a33946ba69f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:40.631150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886803e-8728-44c7-9b23-a33946ba69f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:42:40.631448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886803e-8728-44c7-9b23-a33946ba69f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:40.633067 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886803e-8728-44c7-9b23-a33946ba69f2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:40.645038 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1411/2825] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:42:40.649451 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5e903-020b-490a-8fc0-6c7074de1539 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:40.659032 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5e903-020b-490a-8fc0-6c7074de1539 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:40.664027 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2156119-a9f9-4c78-b83a-4ba8ee6ad0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:40.664639 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2156119-a9f9-4c78-b83a-4ba8ee6ad0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:40.664920 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2156119-a9f9-4c78-b83a-4ba8ee6ad0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:40.665193 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2156119-a9f9-4c78-b83a-4ba8ee6ad0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:40.665879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2156119-a9f9-4c78-b83a-4ba8ee6ad0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:40.667789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2156119-a9f9-4c78-b83a-4ba8ee6ad0c7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:40.785314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1415/2826] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:40 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:40.789281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886803e-8728-44c7-9b23-a33946ba69f2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:40.799195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886803e-8728-44c7-9b23-a33946ba69f2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:40.856777 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f99fa-a732-4b67-bbad-f4fad8afb01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:40.857762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f99fa-a732-4b67-bbad-f4fad8afb01c admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:40.858272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f99fa-a732-4b67-bbad-f4fad8afb01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:40.859093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f99fa-a732-4b67-bbad-f4fad8afb01c admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:40.859751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f99fa-a732-4b67-bbad-f4fad8afb01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:40.861732 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f99fa-a732-4b67-bbad-f4fad8afb01c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:40.949361 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1412/2827] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:40 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:40.953454 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2156119-a9f9-4c78-b83a-4ba8ee6ad0c7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:40.963735 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2156119-a9f9-4c78-b83a-4ba8ee6ad0c7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:40.968380 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c1d3-c800-4485-a844-d16c267fc698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:40.969002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c1d3-c800-4485-a844-d16c267fc698 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:40.969274 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c1d3-c800-4485-a844-d16c267fc698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:40.969542 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c1d3-c800-4485-a844-d16c267fc698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:40.970180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6c1d3-c800-4485-a844-d16c267fc698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:40.971799 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6c1d3-c800-4485-a844-d16c267fc698 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:40.982023 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1416/2828] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:40.985841 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f99fa-a732-4b67-bbad-f4fad8afb01c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:40.995760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f99fa-a732-4b67-bbad-f4fad8afb01c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:41.001058 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f0b07-b6fd-4d5e-8caa-c8a4c04b833d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:41.001652 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f0b07-b6fd-4d5e-8caa-c8a4c04b833d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:41.001928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f0b07-b6fd-4d5e-8caa-c8a4c04b833d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:41.002196 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f0b07-b6fd-4d5e-8caa-c8a4c04b833d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:41.002825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f0b07-b6fd-4d5e-8caa-c8a4c04b833d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:41.004668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f0b07-b6fd-4d5e-8caa-c8a4c04b833d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:41.015062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1413/2829] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:41.019428 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c1d3-c800-4485-a844-d16c267fc698 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:41.029812 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c1d3-c800-4485-a844-d16c267fc698 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:41.034412 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7bb65-db5b-41b4-bff4-b25144f4dba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:41.035055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7bb65-db5b-41b4-bff4-b25144f4dba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:41.035383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7bb65-db5b-41b4-bff4-b25144f4dba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:41.035606 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7bb65-db5b-41b4-bff4-b25144f4dba8 admin admin] PATH_INFO: `/v3/projects/82fff1abc7b943a1b1ca76fe9488c22c/users/932c443f17c34dbe978b26f6c1288add/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:41.050341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7bb65-db5b-41b4-bff4-b25144f4dba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fff1abc7b943a1b1ca76fe9488c22c, user_id=932c443f17c34dbe978b26f6c1288add, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:41.053079 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7bb65-db5b-41b4-bff4-b25144f4dba8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:41.120443 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1417/2830] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:41 2022] PUT /identity/v3/projects/82fff1abc7b943a1b1ca76fe9488c22c/users/932c443f17c34dbe978b26f6c1288add/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:41.131701 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125735e4-8183-41f8-95d6-d35c3ff72505 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:41.132023 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125735e4-8183-41f8-95d6-d35c3ff72505 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:41.132313 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125735e4-8183-41f8-95d6-d35c3ff72505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:41.159840 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-125735e4-8183-41f8-95d6-d35c3ff72505 None None] MFA Rules not processed for user `932c443f17c34dbe978b26f6c1288add`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:41.161140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-125735e4-8183-41f8-95d6-d35c3ff72505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:41.224966 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1414/2831] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:41.237269 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7bb65-db5b-41b4-bff4-b25144f4dba8 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:41.238940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-73a7bb65-db5b-41b4-bff4-b25144f4dba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:41.295545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7bb65-db5b-41b4-bff4-b25144f4dba8 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:41.299179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b11be-79e3-40ce-aa7c-f650eec802eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6267b159204df7af8a4f84d227f88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:41.299790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b11be-79e3-40ce-aa7c-f650eec802eb service glance] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:41.300095 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b11be-79e3-40ce-aa7c-f650eec802eb service glance] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:41.300367 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b11be-79e3-40ce-aa7c-f650eec802eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:41.308460 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b11be-79e3-40ce-aa7c-f650eec802eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:41.314288 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b11be-79e3-40ce-aa7c-f650eec802eb service glance] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:41.319129 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1418/2832] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:43.740004 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125735e4-8183-41f8-95d6-d35c3ff72505 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:43.741496 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-125735e4-8183-41f8-95d6-d35c3ff72505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:43.776394 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:43.810277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125735e4-8183-41f8-95d6-d35c3ff72505 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:43.814884 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:43.815507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:43.815805 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:43.816106 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] PATH_INFO: `/v3/users/84d7fbc3a1594df993784952887d5c22` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:43.817280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d7fbc3a1594df993784952887d5c22)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:43.819225 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:44.035151 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d7fbc3a1594df993784952887d5c22'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:44.109818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d7fbc3a1594df993784952887d5c22'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:44.117622 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d7fbc3a1594df993784952887d5c22'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:44.118305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d7fbc3a1594df993784952887d5c22'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:44.131359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d7fbc3a1594df993784952887d5c22'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:44.138022 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1415/2833] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:43 2022] DELETE /identity/v3/users/84d7fbc3a1594df993784952887d5c22 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:44.143500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b74964-5605-4105-9363-49156c3e761b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:44.143995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b74964-5605-4105-9363-49156c3e761b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:44.144092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b74964-5605-4105-9363-49156c3e761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:44.163233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-19b74964-5605-4105-9363-49156c3e761b None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:44.164456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-19b74964-5605-4105-9363-49156c3e761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:44.194756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:44.225209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1419/2834] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:44.239517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:44.241143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:44.302460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e41c1b-77cf-44d8-bfe8-b00b8810388e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:44.306083 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0616a-f593-4fca-94dc-8121fa94293d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:44.306687 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0616a-f593-4fca-94dc-8121fa94293d service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:44.306962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0616a-f593-4fca-94dc-8121fa94293d service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:44.307231 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0616a-f593-4fca-94dc-8121fa94293d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:44.316875 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0616a-f593-4fca-94dc-8121fa94293d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:44.318426 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0616a-f593-4fca-94dc-8121fa94293d service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:44.328478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1416/2835] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:44.767026 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b74964-5605-4105-9363-49156c3e761b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:44.768636 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-19b74964-5605-4105-9363-49156c3e761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:44.782770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b74964-5605-4105-9363-49156c3e761b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:44.787816 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:44.788607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:44.789028 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:44.789310 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] PATH_INFO: `/v3/projects/3d54d00f8b49410ca45a2385b004945c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:44.790456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d54d00f8b49410ca45a2385b004945c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:44.792563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:44.890053 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d54d00f8b49410ca45a2385b004945c', 'request_id': 'req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:44.897171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d54d00f8b49410ca45a2385b004945c', 'request_id': 'req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:44.906589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d54d00f8b49410ca45a2385b004945c', 'request_id': 'req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:44.997749 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] The token cache is being invalidate because project 3d54d00f8b49410ca45a2385b004945c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:44.997939 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:44.998612 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:45.000158 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1420/2836] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:44 2022] DELETE /identity/v3/projects/3d54d00f8b49410ca45a2385b004945c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:45.004135 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0616a-f593-4fca-94dc-8121fa94293d service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:45.013671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0616a-f593-4fca-94dc-8121fa94293d service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:45.061526 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:45.071448 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:45.072195 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:45.072473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:45.072745 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] PATH_INFO: `/v3/users/e98d0ee0d70c431396c6f3adab401f9b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:45.073860 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98d0ee0d70c431396c6f3adab401f9b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:45.076323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:45.240234 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98d0ee0d70c431396c6f3adab401f9b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:45.301367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98d0ee0d70c431396c6f3adab401f9b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:45.309089 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98d0ee0d70c431396c6f3adab401f9b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:45.310069 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98d0ee0d70c431396c6f3adab401f9b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:45.323281 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98d0ee0d70c431396c6f3adab401f9b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:45.329808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1417/2837] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:45 2022] DELETE /identity/v3/users/e98d0ee0d70c431396c6f3adab401f9b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:46.031146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:46.032620 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:46.046292 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff8bd5-2da6-4df0-bf44-853dc6b48b8e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:46.105526 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:46.106724 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:46.107003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:46.107300 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] PATH_INFO: `/v3/projects/63a8d9f39637433e8d73bd4461660513` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:46.108586 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a8d9f39637433e8d73bd4461660513)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:46.110506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:46.238868 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a8d9f39637433e8d73bd4461660513', 'request_id': 'req-3abe77d5-46ed-44c6-a7fc-e1da484770d0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:46.244364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a8d9f39637433e8d73bd4461660513', 'request_id': 'req-3abe77d5-46ed-44c6-a7fc-e1da484770d0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:46.245442 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:46.252355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a8d9f39637433e8d73bd4461660513', 'request_id': 'req-3abe77d5-46ed-44c6-a7fc-e1da484770d0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:46.358645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] The token cache is being invalidate because project 63a8d9f39637433e8d73bd4461660513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:46.358938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:46.359585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:46.361156 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1421/2838] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:46 2022] DELETE /identity/v3/projects/63a8d9f39637433e8d73bd4461660513 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:46.365208 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:46.366684 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:46.388468 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502d0f4-c9d3-4a78-8cfc-9cbf1e12677f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:46.444081 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:46.444708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:46.444988 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:46.445259 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] PATH_INFO: `/v3/users/ca8f958073f04933829ec8ab0accbd04` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:46.446380 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8f958073f04933829ec8ab0accbd04)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:46.448328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:46.624179 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8f958073f04933829ec8ab0accbd04'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:46.696177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8f958073f04933829ec8ab0accbd04'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:46.704133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8f958073f04933829ec8ab0accbd04'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:46.704781 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8f958073f04933829ec8ab0accbd04'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:46.711798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:46.717746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ab51a8d0-5591-483c-a5f3-c020a98d1d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8f958073f04933829ec8ab0accbd04'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:46.723703 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1418/2839] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:42:46 2022] DELETE /identity/v3/users/ca8f958073f04933829ec8ab0accbd04 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:47.148937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:47.150457 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:47.165303 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe77d5-46ed-44c6-a7fc-e1da484770d0 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:47.226315 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:47.226959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:47.227233 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:47.227573 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] PATH_INFO: `/v3/projects/a19728bf000c43e58a40af6d72ee69d2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:47.228698 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19728bf000c43e58a40af6d72ee69d2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:47.230971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:47.324342 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19728bf000c43e58a40af6d72ee69d2', 'request_id': 'req-cfddf12f-e630-41cd-938f-3221bbf4438e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:47.330603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19728bf000c43e58a40af6d72ee69d2', 'request_id': 'req-cfddf12f-e630-41cd-938f-3221bbf4438e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:47.337585 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19728bf000c43e58a40af6d72ee69d2', 'request_id': 'req-cfddf12f-e630-41cd-938f-3221bbf4438e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:47.422258 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] The token cache is being invalidate because project a19728bf000c43e58a40af6d72ee69d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:42:47.425252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:47.425252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-cfddf12f-e630-41cd-938f-3221bbf4438e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:42:47.425252 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1422/2840] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:42:47 2022] DELETE /identity/v3/projects/a19728bf000c43e58a40af6d72ee69d2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:47.430812 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a525c-5f54-4a98-b7a0-edc9c650cb13 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:47.431320 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a525c-5f54-4a98-b7a0-edc9c650cb13 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:47.431564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a525c-5f54-4a98-b7a0-edc9c650cb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:47.451811 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ff0a525c-5f54-4a98-b7a0-edc9c650cb13 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:47.453020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ff0a525c-5f54-4a98-b7a0-edc9c650cb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:47.512509 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1419/2841] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:47.520852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89d2e0-ab39-42a1-acdc-ea09f6b3406a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:47.521129 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89d2e0-ab39-42a1-acdc-ea09f6b3406a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:47.521394 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89d2e0-ab39-42a1-acdc-ea09f6b3406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:47.540576 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-bb89d2e0-ab39-42a1-acdc-ea09f6b3406a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:47.541753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bb89d2e0-ab39-42a1-acdc-ea09f6b3406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:47.549984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1423/2842] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:47.554036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a525c-5f54-4a98-b7a0-edc9c650cb13 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:47.564266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a525c-5f54-4a98-b7a0-edc9c650cb13 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:47.568842 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d93ce-1e4a-41fb-96f6-d470dfa9a872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:47.569432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d93ce-1e4a-41fb-96f6-d470dfa9a872 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:47.569708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d93ce-1e4a-41fb-96f6-d470dfa9a872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:47.569978 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d93ce-1e4a-41fb-96f6-d470dfa9a872 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:47.570612 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d93ce-1e4a-41fb-96f6-d470dfa9a872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:42:47.570910 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d93ce-1e4a-41fb-96f6-d470dfa9a872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:47.572535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d93ce-1e4a-41fb-96f6-d470dfa9a872 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:47.583686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1420/2843] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:42:47.587850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89d2e0-ab39-42a1-acdc-ea09f6b3406a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:47.596919 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89d2e0-ab39-42a1-acdc-ea09f6b3406a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:47.601531 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cdc25-311c-4fd8-9057-d11fe7204adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:47.602121 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cdc25-311c-4fd8-9057-d11fe7204adc admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:47.602386 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cdc25-311c-4fd8-9057-d11fe7204adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:47.602653 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cdc25-311c-4fd8-9057-d11fe7204adc admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:47.603276 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cdc25-311c-4fd8-9057-d11fe7204adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:47.605180 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cdc25-311c-4fd8-9057-d11fe7204adc admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:47.726298 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1424/2844] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:47 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:47.730532 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d93ce-1e4a-41fb-96f6-d470dfa9a872 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:47.741533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d93ce-1e4a-41fb-96f6-d470dfa9a872 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:47.861955 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcbba6-936a-406f-b3cc-bb6551be3bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:47.862566 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcbba6-936a-406f-b3cc-bb6551be3bad admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:47.862845 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcbba6-936a-406f-b3cc-bb6551be3bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:47.863120 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcbba6-936a-406f-b3cc-bb6551be3bad admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:47.863759 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcbba6-936a-406f-b3cc-bb6551be3bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:47.865730 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcbba6-936a-406f-b3cc-bb6551be3bad admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:47.961564 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1421/2845] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:47 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:47.966000 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cdc25-311c-4fd8-9057-d11fe7204adc admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:47.976408 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cdc25-311c-4fd8-9057-d11fe7204adc admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:47.980937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcccd1-68b3-4cbd-9a08-5698b7e557c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:47.982100 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcccd1-68b3-4cbd-9a08-5698b7e557c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:47.982357 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcccd1-68b3-4cbd-9a08-5698b7e557c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:47.982626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcccd1-68b3-4cbd-9a08-5698b7e557c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:47.983261 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcccd1-68b3-4cbd-9a08-5698b7e557c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:47.984898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcccd1-68b3-4cbd-9a08-5698b7e557c8 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:47.994672 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1425/2846] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:47.998524 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcbba6-936a-406f-b3cc-bb6551be3bad admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:48.008540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcbba6-936a-406f-b3cc-bb6551be3bad admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:48.013138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce692bae-836a-484c-9cc4-0fa388a112a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:48.013731 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692bae-836a-484c-9cc4-0fa388a112a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:48.014010 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692bae-836a-484c-9cc4-0fa388a112a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:48.014283 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692bae-836a-484c-9cc4-0fa388a112a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:48.014913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce692bae-836a-484c-9cc4-0fa388a112a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:48.016792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce692bae-836a-484c-9cc4-0fa388a112a4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:48.027054 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1422/2847] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:42:48.031377 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcccd1-68b3-4cbd-9a08-5698b7e557c8 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:48.042178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcccd1-68b3-4cbd-9a08-5698b7e557c8 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:48.048151 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de83bec-475b-427e-93fd-68f56190c807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:48.049003 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de83bec-475b-427e-93fd-68f56190c807 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:48.049371 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de83bec-475b-427e-93fd-68f56190c807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:48.049682 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de83bec-475b-427e-93fd-68f56190c807 admin admin] PATH_INFO: `/v3/projects/4a58f84bcd1547d8814e5115b2bcc310/users/33d975606ada42beb7ebc1a1d8ecad21/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:48.066789 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de83bec-475b-427e-93fd-68f56190c807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a58f84bcd1547d8814e5115b2bcc310, user_id=33d975606ada42beb7ebc1a1d8ecad21, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:48.069555 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de83bec-475b-427e-93fd-68f56190c807 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:48.144254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1426/2848] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:48 2022] PUT /identity/v3/projects/4a58f84bcd1547d8814e5115b2bcc310/users/33d975606ada42beb7ebc1a1d8ecad21/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:48.149388 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d62be8-0ac4-40d2-ae85-a64dc1cb4c6f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:48.149668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d62be8-0ac4-40d2-ae85-a64dc1cb4c6f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:48.149979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d62be8-0ac4-40d2-ae85-a64dc1cb4c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:48.170696 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f3d62be8-0ac4-40d2-ae85-a64dc1cb4c6f None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:48.171971 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f3d62be8-0ac4-40d2-ae85-a64dc1cb4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:48.221141 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:48.232261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1423/2849] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:48.242064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de83bec-475b-427e-93fd-68f56190c807 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:48.246092 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2de83bec-475b-427e-93fd-68f56190c807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:48.258094 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:48.300563 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de83bec-475b-427e-93fd-68f56190c807 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:48.304267 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0ea57-0322-4974-93d5-5b285a10bf82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:48.304872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0ea57-0322-4974-93d5-5b285a10bf82 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:48.305147 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0ea57-0322-4974-93d5-5b285a10bf82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:48.305444 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0ea57-0322-4974-93d5-5b285a10bf82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:48.315063 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0ea57-0322-4974-93d5-5b285a10bf82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:48.316843 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0ea57-0322-4974-93d5-5b285a10bf82 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:48.327988 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1427/2850] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:49.556691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f355c7e-645f-42a3-95d5-5adb1f1a1845 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:49.556691 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f355c7e-645f-42a3-95d5-5adb1f1a1845 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:49.557250 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f355c7e-645f-42a3-95d5-5adb1f1a1845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:49.584676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3f355c7e-645f-42a3-95d5-5adb1f1a1845 None None] MFA Rules not processed for user `33d975606ada42beb7ebc1a1d8ecad21`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:49.585872 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3f355c7e-645f-42a3-95d5-5adb1f1a1845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:49.658005 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1424/2851] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:49.662502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0ea57-0322-4974-93d5-5b285a10bf82 service neutron] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:49.672318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0ea57-0322-4974-93d5-5b285a10bf82 service neutron] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:49.677239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e998bfd-7b05-4165-b4c8-637562b72ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:49.677836 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e998bfd-7b05-4165-b4c8-637562b72ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:49.678250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e998bfd-7b05-4165-b4c8-637562b72ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:49.678530 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e998bfd-7b05-4165-b4c8-637562b72ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:49.679383 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e998bfd-7b05-4165-b4c8-637562b72ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:49.681591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e998bfd-7b05-4165-b4c8-637562b72ea1 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:49.771861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1428/2852] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:42:49 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:42:49.776172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f355c7e-645f-42a3-95d5-5adb1f1a1845 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:49.787559 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f355c7e-645f-42a3-95d5-5adb1f1a1845 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:49.846140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99181b-6267-4ddb-b98b-dd3575a20677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:49.846757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99181b-6267-4ddb-b98b-dd3575a20677 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:49.847031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99181b-6267-4ddb-b98b-dd3575a20677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:49.847299 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99181b-6267-4ddb-b98b-dd3575a20677 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:49.847959 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99181b-6267-4ddb-b98b-dd3575a20677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:49.849894 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99181b-6267-4ddb-b98b-dd3575a20677 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:49.926600 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1425/2853] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:42:49 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 09:42:49.930866 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e998bfd-7b05-4165-b4c8-637562b72ea1 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:49.941848 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e998bfd-7b05-4165-b4c8-637562b72ea1 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:49.946924 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca370955-45e2-4304-b834-464b2b11b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:49.947525 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370955-45e2-4304-b834-464b2b11b181 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:49.947803 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370955-45e2-4304-b834-464b2b11b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:49.948105 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370955-45e2-4304-b834-464b2b11b181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:49.948864 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca370955-45e2-4304-b834-464b2b11b181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:49.951179 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca370955-45e2-4304-b834-464b2b11b181 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:49.962532 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1429/2854] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:49.967449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99181b-6267-4ddb-b98b-dd3575a20677 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:49.978314 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99181b-6267-4ddb-b98b-dd3575a20677 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:49.983273 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddc9ce-8c89-4775-8f4b-a23bf2f466d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:49.983962 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddc9ce-8c89-4775-8f4b-a23bf2f466d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:49.984239 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddc9ce-8c89-4775-8f4b-a23bf2f466d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:49.984507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddc9ce-8c89-4775-8f4b-a23bf2f466d9 admin admin] PATH_INFO: `/v3/projects/c41063ab4ea6485998751eec448535f3/users/4518a93a6e2d4676be77531bbcc2d73e/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:49.999619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddc9ce-8c89-4775-8f4b-a23bf2f466d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41063ab4ea6485998751eec448535f3, user_id=4518a93a6e2d4676be77531bbcc2d73e, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:50.002284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddc9ce-8c89-4775-8f4b-a23bf2f466d9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:50.083398 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1426/2855] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:49 2022] PUT /identity/v3/projects/c41063ab4ea6485998751eec448535f3/users/4518a93a6e2d4676be77531bbcc2d73e/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:50.090681 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca370955-45e2-4304-b834-464b2b11b181 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:50.100878 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca370955-45e2-4304-b834-464b2b11b181 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:50.155853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a3fac-7daa-434e-a01e-b67218260b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:50.156474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a3fac-7daa-434e-a01e-b67218260b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:50.156746 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a3fac-7daa-434e-a01e-b67218260b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:50.157012 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a3fac-7daa-434e-a01e-b67218260b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:50.157635 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a3fac-7daa-434e-a01e-b67218260b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:50.159216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a3fac-7daa-434e-a01e-b67218260b23 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:50.169178 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1430/2856] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:42:50.173306 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddc9ce-8c89-4775-8f4b-a23bf2f466d9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:50.183557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddc9ce-8c89-4775-8f4b-a23bf2f466d9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:50.188717 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fefff-1d17-4cfb-afce-be0817a34358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:50.189364 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fefff-1d17-4cfb-afce-be0817a34358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:50.189642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fefff-1d17-4cfb-afce-be0817a34358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:50.189916 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fefff-1d17-4cfb-afce-be0817a34358 admin admin] PATH_INFO: `/v3/projects/c41063ab4ea6485998751eec448535f3/users/4518a93a6e2d4676be77531bbcc2d73e/roles/04d1bc62091440e189989e4b973a6627` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:50.191993 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fefff-1d17-4cfb-afce-be0817a34358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41063ab4ea6485998751eec448535f3, user_id=4518a93a6e2d4676be77531bbcc2d73e, role_id=04d1bc62091440e189989e4b973a6627)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:50.194797 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fefff-1d17-4cfb-afce-be0817a34358 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:50.207031 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1427/2857] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:42:50 2022] PUT /identity/v3/projects/c41063ab4ea6485998751eec448535f3/users/4518a93a6e2d4676be77531bbcc2d73e/roles/04d1bc62091440e189989e4b973a6627 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:42:51.436332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bee95-7064-4133-95e4-b99f343f0e5f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:51.436908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bee95-7064-4133-95e4-b99f343f0e5f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:51.436908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bee95-7064-4133-95e4-b99f343f0e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:51.467203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d69bee95-7064-4133-95e4-b99f343f0e5f None None] MFA Rules not processed for user `4518a93a6e2d4676be77531bbcc2d73e`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:51.468589 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d69bee95-7064-4133-95e4-b99f343f0e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:51.539500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1431/2858] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:51.551619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb223-def0-495c-a12c-dae84a4e6c15 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:51.552166 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb223-def0-495c-a12c-dae84a4e6c15 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:51.552277 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb223-def0-495c-a12c-dae84a4e6c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:51.571473 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-424cb223-def0-495c-a12c-dae84a4e6c15 None None] MFA Rules not processed for user `33d975606ada42beb7ebc1a1d8ecad21`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:42:51.572627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-424cb223-def0-495c-a12c-dae84a4e6c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:51.607418 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:51.632911 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1428/2859] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:42:51.646355 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bee95-7064-4133-95e4-b99f343f0e5f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:51.647792 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d69bee95-7064-4133-95e4-b99f343f0e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:51.654757 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:51.720851 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bee95-7064-4133-95e4-b99f343f0e5f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:51.726314 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e1b7-8a2b-450f-8702-8dd59f6b43e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:51.726943 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e1b7-8a2b-450f-8702-8dd59f6b43e7 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:51.727215 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e1b7-8a2b-450f-8702-8dd59f6b43e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:51.727483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e1b7-8a2b-450f-8702-8dd59f6b43e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:51.735649 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79e1b7-8a2b-450f-8702-8dd59f6b43e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:51.737299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79e1b7-8a2b-450f-8702-8dd59f6b43e7 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:51.747556 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1432/2860] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:51.980980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cb223-def0-495c-a12c-dae84a4e6c15 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:52.037168 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cb223-def0-495c-a12c-dae84a4e6c15 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:52.040673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304adef8-d915-4725-8de1-10f8127f1b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:52.041266 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304adef8-d915-4725-8de1-10f8127f1b29 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:52.041540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304adef8-d915-4725-8de1-10f8127f1b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:52.041808 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304adef8-d915-4725-8de1-10f8127f1b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:52.043508 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-304adef8-d915-4725-8de1-10f8127f1b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:52.053305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304adef8-d915-4725-8de1-10f8127f1b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:52.054707 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304adef8-d915-4725-8de1-10f8127f1b29 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:52.063137 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1429/2861] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:52.501604 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e1b7-8a2b-450f-8702-8dd59f6b43e7 service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:52.503174 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2e79e1b7-8a2b-450f-8702-8dd59f6b43e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:52.579932 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e1b7-8a2b-450f-8702-8dd59f6b43e7 service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:52.584893 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838dd2d-bb0b-4633-9895-cc7aa177b267 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:52.585472 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838dd2d-bb0b-4633-9895-cc7aa177b267 service placement] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:52.585760 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838dd2d-bb0b-4633-9895-cc7aa177b267 service placement] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:52.586016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838dd2d-bb0b-4633-9895-cc7aa177b267 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:52.587707 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5838dd2d-bb0b-4633-9895-cc7aa177b267 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:52.599365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838dd2d-bb0b-4633-9895-cc7aa177b267 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:52.600953 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838dd2d-bb0b-4633-9895-cc7aa177b267 service placement] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:52.610906 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1433/2862] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:42:55.877469 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304adef8-d915-4725-8de1-10f8127f1b29 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:55.886771 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304adef8-d915-4725-8de1-10f8127f1b29 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:55.891110 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51361ea-7d30-4b29-95bb-38550f322651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:55.892040 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51361ea-7d30-4b29-95bb-38550f322651 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:55.892478 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51361ea-7d30-4b29-95bb-38550f322651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:55.892755 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51361ea-7d30-4b29-95bb-38550f322651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:55.894520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d51361ea-7d30-4b29-95bb-38550f322651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:55.905238 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51361ea-7d30-4b29-95bb-38550f322651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:55.906775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51361ea-7d30-4b29-95bb-38550f322651 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:55.915291 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1430/2863] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:42:56.706591 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838dd2d-bb0b-4633-9895-cc7aa177b267 service placement] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:42:56.708096 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5838dd2d-bb0b-4633-9895-cc7aa177b267 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:56.724755 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838dd2d-bb0b-4633-9895-cc7aa177b267 service placement] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:42:56.731065 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ead40-fc32-4ce4-894f-718b5f69c002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:42:56.731701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ead40-fc32-4ce4-894f-718b5f69c002 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:42:56.732626 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ead40-fc32-4ce4-894f-718b5f69c002 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:42:56.732871 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ead40-fc32-4ce4-894f-718b5f69c002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:42:56.734602 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fb2ead40-fc32-4ce4-894f-718b5f69c002 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:42:56.747549 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ead40-fc32-4ce4-894f-718b5f69c002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:42:56.749187 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ead40-fc32-4ce4-894f-718b5f69c002 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:42:56.760878 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1434/2864] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:42:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:43:02.290158 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51361ea-7d30-4b29-95bb-38550f322651 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:02.309218 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51361ea-7d30-4b29-95bb-38550f322651 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:02.309802 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337903f-6025-44db-abfc-bc5b4fd9e468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74d78932554527a8bcb5880b2b9c96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:02.310399 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337903f-6025-44db-abfc-bc5b4fd9e468 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:02.310678 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337903f-6025-44db-abfc-bc5b4fd9e468 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:02.310951 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337903f-6025-44db-abfc-bc5b4fd9e468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:02.312705 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f337903f-6025-44db-abfc-bc5b4fd9e468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:02.325184 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337903f-6025-44db-abfc-bc5b4fd9e468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:02.327249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337903f-6025-44db-abfc-bc5b4fd9e468 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:02.338284 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1431/2865] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:43:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:43:06.755598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=70 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:07.991041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ead40-fc32-4ce4-894f-718b5f69c002 service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:07.992538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fb2ead40-fc32-4ce4-894f-718b5f69c002 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:08.048703 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ead40-fc32-4ce4-894f-718b5f69c002 service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:08.052306 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78aeaa0-fdee-4d0b-8fa1-c4f631a248d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:08.052948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78aeaa0-fdee-4d0b-8fa1-c4f631a248d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:08.053261 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78aeaa0-fdee-4d0b-8fa1-c4f631a248d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:08.053538 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78aeaa0-fdee-4d0b-8fa1-c4f631a248d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:08.063211 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78aeaa0-fdee-4d0b-8fa1-c4f631a248d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:08.064674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78aeaa0-fdee-4d0b-8fa1-c4f631a248d9 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:08.074029 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1435/2866] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:43:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:43:08.312758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337903f-6025-44db-abfc-bc5b4fd9e468 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:08.314138 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f337903f-6025-44db-abfc-bc5b4fd9e468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:08.379068 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337903f-6025-44db-abfc-bc5b4fd9e468 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:08.383980 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:08.384592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:08.384868 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:08.385163 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] PATH_INFO: `/v3/users/932c443f17c34dbe978b26f6c1288add` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:08.386269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932c443f17c34dbe978b26f6c1288add)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:08.388206 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:08.568489 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932c443f17c34dbe978b26f6c1288add'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:08.658517 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932c443f17c34dbe978b26f6c1288add'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:08.664476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:08.666522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932c443f17c34dbe978b26f6c1288add'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:08.667164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932c443f17c34dbe978b26f6c1288add'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:08.679552 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932c443f17c34dbe978b26f6c1288add'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:08.685481 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1432/2867] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:43:08 2022] DELETE /identity/v3/users/932c443f17c34dbe978b26f6c1288add => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:43:08.689935 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce84331-9cb0-47e9-b33e-808cf60a2edc None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:08.690220 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce84331-9cb0-47e9-b33e-808cf60a2edc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:08.690492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce84331-9cb0-47e9-b33e-808cf60a2edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:08.710330 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2ce84331-9cb0-47e9-b33e-808cf60a2edc None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:08.711516 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2ce84331-9cb0-47e9-b33e-808cf60a2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:08.778085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1436/2868] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:08.788377 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:08.789775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:08.847032 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5d527-6994-4032-8315-a2a10a88dff4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:08.850839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae02b9-2860-41c6-8c9c-e97cdd38935c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:08.851472 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae02b9-2860-41c6-8c9c-e97cdd38935c service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:08.851751 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae02b9-2860-41c6-8c9c-e97cdd38935c service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:08.852063 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae02b9-2860-41c6-8c9c-e97cdd38935c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:08.863237 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae02b9-2860-41c6-8c9c-e97cdd38935c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:08.865801 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae02b9-2860-41c6-8c9c-e97cdd38935c service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:08.876573 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1433/2869] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:43:09.276237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce84331-9cb0-47e9-b33e-808cf60a2edc None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:09.277887 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2ce84331-9cb0-47e9-b33e-808cf60a2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:09.291992 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce84331-9cb0-47e9-b33e-808cf60a2edc None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:09.296964 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:09.301619 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:09.301984 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:09.302544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] PATH_INFO: `/v3/projects/82fff1abc7b943a1b1ca76fe9488c22c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:09.304131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82fff1abc7b943a1b1ca76fe9488c22c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:09.306285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:09.445607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82fff1abc7b943a1b1ca76fe9488c22c', 'request_id': 'req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:09.451002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82fff1abc7b943a1b1ca76fe9488c22c', 'request_id': 'req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:09.457474 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82fff1abc7b943a1b1ca76fe9488c22c', 'request_id': 'req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:09.572058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] The token cache is being invalidate because project 82fff1abc7b943a1b1ca76fe9488c22c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:43:09.572348 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:09.572966 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-e8ed1c41-84ae-45b9-ab92-759b7935d6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:09.574473 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1437/2870] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:43:09 2022] DELETE /identity/v3/projects/82fff1abc7b943a1b1ca76fe9488c22c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:43:09.579312 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b8371-95f4-4692-a68c-ba737a9c8b63 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:09.579807 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b8371-95f4-4692-a68c-ba737a9c8b63 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:09.579943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b8371-95f4-4692-a68c-ba737a9c8b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:09.600249 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-231b8371-95f4-4692-a68c-ba737a9c8b63 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:09.601429 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-231b8371-95f4-4692-a68c-ba737a9c8b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:09.661806 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1434/2871] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:09.671254 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c79a-172e-4b88-bc4e-215b9335ec6a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:09.671541 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c79a-172e-4b88-bc4e-215b9335ec6a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:09.671818 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c79a-172e-4b88-bc4e-215b9335ec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:09.692301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5ac8c79a-172e-4b88-bc4e-215b9335ec6a None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:09.693503 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5ac8c79a-172e-4b88-bc4e-215b9335ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:09.704374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1438/2872] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:09.705947 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b8371-95f4-4692-a68c-ba737a9c8b63 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:09.715458 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b8371-95f4-4692-a68c-ba737a9c8b63 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:09.720020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5e81-eaa5-439a-8c3b-e47b7861cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:09.720610 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5e81-eaa5-439a-8c3b-e47b7861cc96 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:09.720890 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5e81-eaa5-439a-8c3b-e47b7861cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:09.721156 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5e81-eaa5-439a-8c3b-e47b7861cc96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:09.721791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a5e81-eaa5-439a-8c3b-e47b7861cc96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:43:09.722095 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a5e81-eaa5-439a-8c3b-e47b7861cc96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:09.723675 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a5e81-eaa5-439a-8c3b-e47b7861cc96 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:09.735442 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1435/2873] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:43:09.739822 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c79a-172e-4b88-bc4e-215b9335ec6a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:09.749907 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c79a-172e-4b88-bc4e-215b9335ec6a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:09.754562 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297280cb-3b37-49c6-8e17-d691aaa58f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:09.755159 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297280cb-3b37-49c6-8e17-d691aaa58f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:09.755438 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297280cb-3b37-49c6-8e17-d691aaa58f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:09.755709 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297280cb-3b37-49c6-8e17-d691aaa58f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:09.756365 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297280cb-3b37-49c6-8e17-d691aaa58f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:09.758353 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297280cb-3b37-49c6-8e17-d691aaa58f80 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:09.862664 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:09.873043 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1439/2874] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:43:09 2022] POST /identity/v3/projects => generated 395 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:43:09.874198 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5e81-eaa5-439a-8c3b-e47b7861cc96 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:09.884167 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5e81-eaa5-439a-8c3b-e47b7861cc96 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:09.939804 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1595ae-f177-494b-b027-3c4b7034b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:09.940435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1595ae-f177-494b-b027-3c4b7034b177 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:09.940711 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1595ae-f177-494b-b027-3c4b7034b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:09.941035 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1595ae-f177-494b-b027-3c4b7034b177 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:09.941642 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1595ae-f177-494b-b027-3c4b7034b177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:09.943535 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1595ae-f177-494b-b027-3c4b7034b177 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:10.011002 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:10.017321 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1436/2875] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:43:09 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:43:10.021459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297280cb-3b37-49c6-8e17-d691aaa58f80 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:10.032428 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297280cb-3b37-49c6-8e17-d691aaa58f80 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:10.037016 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a307-8b24-420b-8478-323bab2880cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:10.037607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a307-8b24-420b-8478-323bab2880cf admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:10.037879 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a307-8b24-420b-8478-323bab2880cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:10.038146 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a307-8b24-420b-8478-323bab2880cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:10.038777 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555a307-8b24-420b-8478-323bab2880cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:10.040440 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555a307-8b24-420b-8478-323bab2880cf admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:10.050800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1440/2876] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:43:10.054661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1595ae-f177-494b-b027-3c4b7034b177 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:10.064586 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1595ae-f177-494b-b027-3c4b7034b177 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:10.069199 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60f138-66f2-4c29-b866-a7f701043855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:10.069784 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f138-66f2-4c29-b866-a7f701043855 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:10.070061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f138-66f2-4c29-b866-a7f701043855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:10.070330 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f138-66f2-4c29-b866-a7f701043855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:10.070985 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60f138-66f2-4c29-b866-a7f701043855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:10.072599 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60f138-66f2-4c29-b866-a7f701043855 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:10.083738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1437/2877] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:43:10.087770 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a307-8b24-420b-8478-323bab2880cf admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:10.098006 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a307-8b24-420b-8478-323bab2880cf admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:10.102603 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae177f8-e62f-4ba4-a347-c906dd2a7794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:10.103241 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae177f8-e62f-4ba4-a347-c906dd2a7794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:10.103522 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae177f8-e62f-4ba4-a347-c906dd2a7794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:10.103790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae177f8-e62f-4ba4-a347-c906dd2a7794 admin admin] PATH_INFO: `/v3/projects/59cc08c1047c4f3d80d0ad6445eb15d7/users/b52897749ce5409d83ecb2eb9d5d7430/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:10.118756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae177f8-e62f-4ba4-a347-c906dd2a7794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cc08c1047c4f3d80d0ad6445eb15d7, user_id=b52897749ce5409d83ecb2eb9d5d7430, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:10.121450 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae177f8-e62f-4ba4-a347-c906dd2a7794 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:10.184085 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1441/2878] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:43:10 2022] PUT /identity/v3/projects/59cc08c1047c4f3d80d0ad6445eb15d7/users/b52897749ce5409d83ecb2eb9d5d7430/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:43:10.194280 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9de5-f5bd-4217-938c-175f760e0dd2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:10.194563 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9de5-f5bd-4217-938c-175f760e0dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:10.194836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9de5-f5bd-4217-938c-175f760e0dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:10.223743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bb7c9de5-f5bd-4217-938c-175f760e0dd2 None None] MFA Rules not processed for user `b52897749ce5409d83ecb2eb9d5d7430`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:10.224915 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bb7c9de5-f5bd-4217-938c-175f760e0dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:10.286507 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1438/2879] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:10.297722 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae177f8-e62f-4ba4-a347-c906dd2a7794 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:10.299458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1ae177f8-e62f-4ba4-a347-c906dd2a7794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:10.355344 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae177f8-e62f-4ba4-a347-c906dd2a7794 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:10.359017 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b305fcd-fad7-4ac1-ae67-923120d79911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:10.359617 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b305fcd-fad7-4ac1-ae67-923120d79911 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:10.359922 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b305fcd-fad7-4ac1-ae67-923120d79911 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:10.360196 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b305fcd-fad7-4ac1-ae67-923120d79911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:10.368216 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b305fcd-fad7-4ac1-ae67-923120d79911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:10.369645 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b305fcd-fad7-4ac1-ae67-923120d79911 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:10.378250 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1442/2880] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:43:10 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:43:16.321390 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9de5-f5bd-4217-938c-175f760e0dd2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:16.387157 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9de5-f5bd-4217-938c-175f760e0dd2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:16.392131 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:16.393082 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:16.393357 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:16.393629 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] PATH_INFO: `/v3/users/b52897749ce5409d83ecb2eb9d5d7430` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:16.394792 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52897749ce5409d83ecb2eb9d5d7430)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:16.396774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:16.646670 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52897749ce5409d83ecb2eb9d5d7430'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:16.719602 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52897749ce5409d83ecb2eb9d5d7430'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:16.727222 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52897749ce5409d83ecb2eb9d5d7430'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:16.727836 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52897749ce5409d83ecb2eb9d5d7430'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:16.739180 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:16.740399 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52897749ce5409d83ecb2eb9d5d7430'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:16.746323 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1439/2881] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:43:16 2022] DELETE /identity/v3/users/b52897749ce5409d83ecb2eb9d5d7430 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:43:16.750850 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7e3ea-395f-4879-b485-9618c667ef91 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:16.751313 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7e3ea-395f-4879-b485-9618c667ef91 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:16.751418 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7e3ea-395f-4879-b485-9618c667ef91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:16.771629 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6cf7e3ea-395f-4879-b485-9618c667ef91 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:16.772873 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6cf7e3ea-395f-4879-b485-9618c667ef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:16.831826 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1443/2882] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:16.841686 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:16.843123 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:16.899316 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07984fa3-bde1-421b-a6c2-c7fbf312cc74 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:16.902798 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dba756-e303-4799-bba1-2dedf3d5623f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:16.903387 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dba756-e303-4799-bba1-2dedf3d5623f service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:16.903660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dba756-e303-4799-bba1-2dedf3d5623f service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:16.903960 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dba756-e303-4799-bba1-2dedf3d5623f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:16.913227 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dba756-e303-4799-bba1-2dedf3d5623f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:16.914636 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dba756-e303-4799-bba1-2dedf3d5623f service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:16.923794 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1440/2883] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:43:17.277842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7e3ea-395f-4879-b485-9618c667ef91 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:17.279768 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6cf7e3ea-395f-4879-b485-9618c667ef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:17.292551 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7e3ea-395f-4879-b485-9618c667ef91 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:17.297364 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:17.301413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:17.301413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:17.301413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] PATH_INFO: `/v3/projects/59cc08c1047c4f3d80d0ad6445eb15d7` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:17.301413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cc08c1047c4f3d80d0ad6445eb15d7)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:17.301854 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:17.406537 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cc08c1047c4f3d80d0ad6445eb15d7', 'request_id': 'req-6897f939-1bc2-43aa-b42e-b0b72d88c386'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:17.412501 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cc08c1047c4f3d80d0ad6445eb15d7', 'request_id': 'req-6897f939-1bc2-43aa-b42e-b0b72d88c386'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:17.416115 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:17.419055 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cc08c1047c4f3d80d0ad6445eb15d7', 'request_id': 'req-6897f939-1bc2-43aa-b42e-b0b72d88c386'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:17.495863 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] The token cache is being invalidate because project 59cc08c1047c4f3d80d0ad6445eb15d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:43:17.496230 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:17.496842 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-6897f939-1bc2-43aa-b42e-b0b72d88c386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:17.498332 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1444/2884] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:43:17 2022] DELETE /identity/v3/projects/59cc08c1047c4f3d80d0ad6445eb15d7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:43:26.919651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=28 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:27.639800 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:30.544656 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157a3b4-41fd-4201-a19f-df59980fd74b None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:30.545145 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157a3b4-41fd-4201-a19f-df59980fd74b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:30.545256 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157a3b4-41fd-4201-a19f-df59980fd74b None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:30.546577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1441/2885] 10.222.0.55 () {54 vars in 961 bytes} [Fri Sep 2 09:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 09:43:30.552458 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc867bc-9902-432a-9be4-36919df41b9c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:30.552872 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc867bc-9902-432a-9be4-36919df41b9c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:30.553008 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc867bc-9902-432a-9be4-36919df41b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:30.590078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4cc867bc-9902-432a-9be4-36919df41b9c None None] MFA Rules not processed for user `d1d19d1439914eac9993bf31fa4c9384`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:30.591275 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4cc867bc-9902-432a-9be4-36919df41b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:30.662194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1445/2886] 10.222.0.55 () {58 vars in 1058 bytes} [Fri Sep 2 09:43:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:30.669627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157a3b4-41fd-4201-a19f-df59980fd74b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:30.683640 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157a3b4-41fd-4201-a19f-df59980fd74b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:30.689272 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a760dc-6388-441a-a527-9bcee6a7d8cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:30.689887 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a760dc-6388-441a-a527-9bcee6a7d8cd service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:30.690164 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a760dc-6388-441a-a527-9bcee6a7d8cd service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:30.690459 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a760dc-6388-441a-a527-9bcee6a7d8cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:30.692282 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b4a760dc-6388-441a-a527-9bcee6a7d8cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:30.704140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a760dc-6388-441a-a527-9bcee6a7d8cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:30.705723 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a760dc-6388-441a-a527-9bcee6a7d8cd service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:30.716363 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1442/2887] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:43:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:43:31.556114 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc867bc-9902-432a-9be4-36919df41b9c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:31.557717 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4cc867bc-9902-432a-9be4-36919df41b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:31.623152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc867bc-9902-432a-9be4-36919df41b9c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:31.627736 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:31.628958 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:31.629229 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:31.629495 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] PATH_INFO: `/v3/users/33d975606ada42beb7ebc1a1d8ecad21` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:31.630609 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d975606ada42beb7ebc1a1d8ecad21)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:31.632581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:31.768817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d975606ada42beb7ebc1a1d8ecad21'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:31.769459 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d975606ada42beb7ebc1a1d8ecad21'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:31.781058 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d975606ada42beb7ebc1a1d8ecad21'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:31.787756 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d975606ada42beb7ebc1a1d8ecad21'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:31.835806 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d975606ada42beb7ebc1a1d8ecad21'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:31.841959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1446/2888] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:43:31 2022] DELETE /identity/v3/users/33d975606ada42beb7ebc1a1d8ecad21 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:43:32.060574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a760dc-6388-441a-a527-9bcee6a7d8cd service placement] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:32.071432 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a760dc-6388-441a-a527-9bcee6a7d8cd service placement] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:32.129485 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:32.130115 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:32.130394 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:32.130669 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] PATH_INFO: `/v3/projects/4a58f84bcd1547d8814e5115b2bcc310` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:32.131774 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a58f84bcd1547d8814e5115b2bcc310)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:32.133758 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:32.256515 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a58f84bcd1547d8814e5115b2bcc310', 'request_id': 'req-9961c7b1-705f-4c02-82f5-273d8dc7de43'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:32.261793 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a58f84bcd1547d8814e5115b2bcc310', 'request_id': 'req-9961c7b1-705f-4c02-82f5-273d8dc7de43'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:32.267743 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a58f84bcd1547d8814e5115b2bcc310', 'request_id': 'req-9961c7b1-705f-4c02-82f5-273d8dc7de43'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:32.326255 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] The token cache is being invalidate because project 4a58f84bcd1547d8814e5115b2bcc310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:43:32.326539 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:32.327150 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:32.328650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1443/2889] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:43:32 2022] DELETE /identity/v3/projects/4a58f84bcd1547d8814e5115b2bcc310 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:43:32.333379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:32.334753 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:32.343140 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:32.349139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912c65c-d0df-4e31-93c9-e0a41e0f44d9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:32.405341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:32.405990 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:32.406285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:32.406559 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] PATH_INFO: `/v3/users/4518a93a6e2d4676be77531bbcc2d73e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:32.407683 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4518a93a6e2d4676be77531bbcc2d73e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:32.410327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:32.580445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4518a93a6e2d4676be77531bbcc2d73e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:32.581607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4518a93a6e2d4676be77531bbcc2d73e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:32.593700 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4518a93a6e2d4676be77531bbcc2d73e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:32.604363 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4518a93a6e2d4676be77531bbcc2d73e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:32.680147 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-1ebbc9c9-6ba5-4ecc-89fc-05bf96efd4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4518a93a6e2d4676be77531bbcc2d73e'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:32.686587 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1447/2890] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:43:32 2022] DELETE /identity/v3/users/4518a93a6e2d4676be77531bbcc2d73e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:43:32.909939 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:32.911413 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:32.925083 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961c7b1-705f-4c02-82f5-273d8dc7de43 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:32.984577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:32.985202 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:32.985476 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:32.985742 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] PATH_INFO: `/v3/projects/c41063ab4ea6485998751eec448535f3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:32.986911 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41063ab4ea6485998751eec448535f3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:32.989463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:33.011986 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:33.091014 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41063ab4ea6485998751eec448535f3', 'request_id': 'req-e521cff5-953f-4f43-9664-8a94a33fb331'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:33.096349 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41063ab4ea6485998751eec448535f3', 'request_id': 'req-e521cff5-953f-4f43-9664-8a94a33fb331'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:33.102267 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41063ab4ea6485998751eec448535f3', 'request_id': 'req-e521cff5-953f-4f43-9664-8a94a33fb331'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:33.189355 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] The token cache is being invalidate because project c41063ab4ea6485998751eec448535f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:43:33.189639 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:33.190286 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e521cff5-953f-4f43-9664-8a94a33fb331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:43:33.192511 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1444/2891] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:43:32 2022] DELETE /identity/v3/projects/c41063ab4ea6485998751eec448535f3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:43:33.197409 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a387ebc-d765-4343-92fb-e5daecfe04d3 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:33.197701 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a387ebc-d765-4343-92fb-e5daecfe04d3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:33.197975 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a387ebc-d765-4343-92fb-e5daecfe04d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:33.217805 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3a387ebc-d765-4343-92fb-e5daecfe04d3 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:33.219033 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3a387ebc-d765-4343-92fb-e5daecfe04d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:33.280318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1448/2892] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:33.288094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be8fb9-32e3-415b-ad35-89dd31e5a895 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:33.288382 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be8fb9-32e3-415b-ad35-89dd31e5a895 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:33.288660 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be8fb9-32e3-415b-ad35-89dd31e5a895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:33.308577 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-23be8fb9-32e3-415b-ad35-89dd31e5a895 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:33.309783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-23be8fb9-32e3-415b-ad35-89dd31e5a895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:33.318244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1445/2893] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:33.322433 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a387ebc-d765-4343-92fb-e5daecfe04d3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:33.332143 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a387ebc-d765-4343-92fb-e5daecfe04d3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:33.336714 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6494505-cd04-4286-b5e2-886c8913895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:33.337308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6494505-cd04-4286-b5e2-886c8913895d admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:33.337584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6494505-cd04-4286-b5e2-886c8913895d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:33.337853 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6494505-cd04-4286-b5e2-886c8913895d admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:33.338497 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6494505-cd04-4286-b5e2-886c8913895d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:43:33.338797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6494505-cd04-4286-b5e2-886c8913895d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:33.340429 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6494505-cd04-4286-b5e2-886c8913895d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:33.352338 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1449/2894] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 09:43:33.356449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be8fb9-32e3-415b-ad35-89dd31e5a895 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:33.366177 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be8fb9-32e3-415b-ad35-89dd31e5a895 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:33.370813 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd82f-0cb4-4f47-90c0-41889d5b4b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:33.371397 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd82f-0cb4-4f47-90c0-41889d5b4b3a admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:33.371676 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd82f-0cb4-4f47-90c0-41889d5b4b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:33.371984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd82f-0cb4-4f47-90c0-41889d5b4b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:33.372645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cd82f-0cb4-4f47-90c0-41889d5b4b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:33.374527 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cd82f-0cb4-4f47-90c0-41889d5b4b3a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:33.453928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1446/2895] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:43:33 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:43:33.458064 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6494505-cd04-4286-b5e2-886c8913895d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:33.468018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6494505-cd04-4286-b5e2-886c8913895d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:33.473186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:33.524790 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1c6d-fdff-4d62-8efd-dcb12bf66b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:33.525389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1c6d-fdff-4d62-8efd-dcb12bf66b5d admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:33.525688 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1c6d-fdff-4d62-8efd-dcb12bf66b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:33.525971 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1c6d-fdff-4d62-8efd-dcb12bf66b5d admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:33.526584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d1c6d-fdff-4d62-8efd-dcb12bf66b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:33.528545 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d1c6d-fdff-4d62-8efd-dcb12bf66b5d admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:33.630384 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1450/2896] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:43:33 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:43:33.634487 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd82f-0cb4-4f47-90c0-41889d5b4b3a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:33.645253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd82f-0cb4-4f47-90c0-41889d5b4b3a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:33.650041 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed7bec-b8ec-4bf0-aed9-7e66fc31af89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:33.650474 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed7bec-b8ec-4bf0-aed9-7e66fc31af89 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:33.650750 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed7bec-b8ec-4bf0-aed9-7e66fc31af89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:33.651020 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed7bec-b8ec-4bf0-aed9-7e66fc31af89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:33.651650 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed7bec-b8ec-4bf0-aed9-7e66fc31af89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:33.653309 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed7bec-b8ec-4bf0-aed9-7e66fc31af89 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:33.663655 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1447/2897] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:43:33.667483 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1c6d-fdff-4d62-8efd-dcb12bf66b5d admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:33.678041 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1c6d-fdff-4d62-8efd-dcb12bf66b5d admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:33.682665 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b9f64-e2c0-478d-8602-ecd0965f6c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:33.683256 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b9f64-e2c0-478d-8602-ecd0965f6c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:33.683533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b9f64-e2c0-478d-8602-ecd0965f6c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:33.683804 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b9f64-e2c0-478d-8602-ecd0965f6c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:33.684468 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b9f64-e2c0-478d-8602-ecd0965f6c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:33.686054 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b9f64-e2c0-478d-8602-ecd0965f6c94 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:33.697611 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1451/2898] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:43:33.701668 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed7bec-b8ec-4bf0-aed9-7e66fc31af89 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:33.712140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed7bec-b8ec-4bf0-aed9-7e66fc31af89 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:33.721328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e17369-c6ca-4398-ada6-f628a8990364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:33.721328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e17369-c6ca-4398-ada6-f628a8990364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:33.721328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e17369-c6ca-4398-ada6-f628a8990364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:33.721328 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e17369-c6ca-4398-ada6-f628a8990364 admin admin] PATH_INFO: `/v3/projects/77fbe107d1744e1e8da04102881ca0b9/users/6c80b688c8f04dfa8686e5755d4f2203/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:33.733905 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e17369-c6ca-4398-ada6-f628a8990364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fbe107d1744e1e8da04102881ca0b9, user_id=6c80b688c8f04dfa8686e5755d4f2203, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:33.736621 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e17369-c6ca-4398-ada6-f628a8990364 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:33.801679 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1448/2899] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:43:33 2022] PUT /identity/v3/projects/77fbe107d1744e1e8da04102881ca0b9/users/6c80b688c8f04dfa8686e5755d4f2203/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:43:33.806882 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0514c-66a9-4ba3-9e38-f72c47837160 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:33.807168 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0514c-66a9-4ba3-9e38-f72c47837160 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:33.807441 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0514c-66a9-4ba3-9e38-f72c47837160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:33.827322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1aa0514c-66a9-4ba3-9e38-f72c47837160 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:33.828593 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1aa0514c-66a9-4ba3-9e38-f72c47837160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:33.887807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1452/2900] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:33.898194 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e17369-c6ca-4398-ada6-f628a8990364 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:33.899995 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e6e17369-c6ca-4398-ada6-f628a8990364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:33.956867 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e17369-c6ca-4398-ada6-f628a8990364 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:33.960540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c889d3f-f8ab-450b-afdb-7c48e843c0cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:33.961133 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c889d3f-f8ab-450b-afdb-7c48e843c0cf service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:33.961404 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c889d3f-f8ab-450b-afdb-7c48e843c0cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:33.961671 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c889d3f-f8ab-450b-afdb-7c48e843c0cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:33.970818 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c889d3f-f8ab-450b-afdb-7c48e843c0cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:33.971941 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c889d3f-f8ab-450b-afdb-7c48e843c0cf service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:33.981170 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1449/2901] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:43:34.969596 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b639b7-2141-4e1f-bbb6-a87f9ffdabd4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:34.970139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b639b7-2141-4e1f-bbb6-a87f9ffdabd4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:34.970139 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b639b7-2141-4e1f-bbb6-a87f9ffdabd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:34.999067 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f3b639b7-2141-4e1f-bbb6-a87f9ffdabd4 None None] MFA Rules not processed for user `6c80b688c8f04dfa8686e5755d4f2203`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:35.000341 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f3b639b7-2141-4e1f-bbb6-a87f9ffdabd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:35.064423 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1453/2902] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:35.075024 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c889d3f-f8ab-450b-afdb-7c48e843c0cf service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:35.076538 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c889d3f-f8ab-450b-afdb-7c48e843c0cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:35.133385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:35.140062 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c889d3f-f8ab-450b-afdb-7c48e843c0cf service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:35.144531 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9c049-bc59-4750-ae09-f6da72e60670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:35.145297 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9c049-bc59-4750-ae09-f6da72e60670 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:35.145746 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9c049-bc59-4750-ae09-f6da72e60670 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:35.146114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9c049-bc59-4750-ae09-f6da72e60670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:35.156520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9c049-bc59-4750-ae09-f6da72e60670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:35.158381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9c049-bc59-4750-ae09-f6da72e60670 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:35.169399 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1450/2903] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:43:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:43:36.954889 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cba538-5732-4c10-a7f6-8457eeda69fa None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:36.955389 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cba538-5732-4c10-a7f6-8457eeda69fa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:36.955496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cba538-5732-4c10-a7f6-8457eeda69fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:36.975107 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f2cba538-5732-4c10-a7f6-8457eeda69fa None None] MFA Rules not processed for user `6c80b688c8f04dfa8686e5755d4f2203`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:36.976321 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f2cba538-5732-4c10-a7f6-8457eeda69fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:36.983070 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1454/2904] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:43:37.218762 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9c049-bc59-4750-ae09-f6da72e60670 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:43:37.220181 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ebc9c049-bc59-4750-ae09-f6da72e60670 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:37.232046 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9c049-bc59-4750-ae09-f6da72e60670 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:43:37.235619 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53614383-45c2-4bb5-aacd-8bf97efdc709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:43:37.236245 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53614383-45c2-4bb5-aacd-8bf97efdc709 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:37.236516 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53614383-45c2-4bb5-aacd-8bf97efdc709 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:37.236783 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53614383-45c2-4bb5-aacd-8bf97efdc709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:37.238460 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-53614383-45c2-4bb5-aacd-8bf97efdc709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:37.247998 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53614383-45c2-4bb5-aacd-8bf97efdc709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:43:37.249407 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53614383-45c2-4bb5-aacd-8bf97efdc709 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:43:37.257820 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1451/2905] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:43:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:43:46.969078 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:47.254226 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=11 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:56.394867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea282b3-f622-475c-9f14-5d5af7c02d03 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:43:56.395379 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea282b3-f622-475c-9f14-5d5af7c02d03 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:43:56.395506 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea282b3-f622-475c-9f14-5d5af7c02d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:43:56.414090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-dea282b3-f622-475c-9f14-5d5af7c02d03 None None] MFA Rules not processed for user `6c80b688c8f04dfa8686e5755d4f2203`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:43:56.415263 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-dea282b3-f622-475c-9f14-5d5af7c02d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:43:56.421991 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1455/2906] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:43:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 09:44:06.408918 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:16.680348 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0decf7-772b-44ee-b14e-b5eae2e12a49 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:16.680885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0decf7-772b-44ee-b14e-b5eae2e12a49 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:16.680885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0decf7-772b-44ee-b14e-b5eae2e12a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:16.728949 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2f0decf7-772b-44ee-b14e-b5eae2e12a49 None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:44:16.730107 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2f0decf7-772b-44ee-b14e-b5eae2e12a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:16.794430 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1452/2907] 10.222.0.55 () {58 vars in 1009 bytes} [Fri Sep 2 09:44:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:44:16.922797 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea282b3-f622-475c-9f14-5d5af7c02d03 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:16.924307 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-dea282b3-f622-475c-9f14-5d5af7c02d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:17.013584 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea282b3-f622-475c-9f14-5d5af7c02d03 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:17.018898 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931563d-c51a-434d-babd-d9487ee29076 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:17.024471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931563d-c51a-434d-babd-d9487ee29076 service swift] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:17.024471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931563d-c51a-434d-babd-d9487ee29076 service swift] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:17.024471 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931563d-c51a-434d-babd-d9487ee29076 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:17.028060 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931563d-c51a-434d-babd-d9487ee29076 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:17.029650 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931563d-c51a-434d-babd-d9487ee29076 service swift] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:17.038133 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1456/2908] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:44:26.791467 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=40 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:27.034581 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=41 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:33.312101 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97aac4-4be2-42da-b29e-a5a12c43cada None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:33.312534 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97aac4-4be2-42da-b29e-a5a12c43cada None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:33.312627 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97aac4-4be2-42da-b29e-a5a12c43cada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:33.331548 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2b97aac4-4be2-42da-b29e-a5a12c43cada None None] MFA Rules not processed for user `2195f7f3cd1d4f35826282958378c754`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:44:33.332779 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2b97aac4-4be2-42da-b29e-a5a12c43cada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:33.339928 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1453/2909] 10.222.0.55 () {58 vars in 967 bytes} [Fri Sep 2 09:44:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:44:33.352171 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931563d-c51a-434d-babd-d9487ee29076 service swift] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:33.362740 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931563d-c51a-434d-babd-d9487ee29076 service swift] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:33.368328 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ca61-4481-4104-a847-2f9ea42104a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01367d6c12014bc0bc9410b4a5a98693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:33.368923 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ca61-4481-4104-a847-2f9ea42104a6 service swift] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:33.369200 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ca61-4481-4104-a847-2f9ea42104a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:33.369475 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ca61-4481-4104-a847-2f9ea42104a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:33.377959 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81ca61-4481-4104-a847-2f9ea42104a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:33.379548 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81ca61-4481-4104-a847-2f9ea42104a6 service swift] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:33.387425 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1457/2910] 10.222.0.55 () {60 vars in 1384 bytes} [Fri Sep 2 09:44:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 09:44:36.198265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97aac4-4be2-42da-b29e-a5a12c43cada None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:36.210296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97aac4-4be2-42da-b29e-a5a12c43cada None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:36.215188 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:36.215816 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:36.216247 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:36.216519 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] PATH_INFO: `/v3/users/6c80b688c8f04dfa8686e5755d4f2203` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:36.217631 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c80b688c8f04dfa8686e5755d4f2203)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:36.219673 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:36.393522 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c80b688c8f04dfa8686e5755d4f2203'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:36.470764 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c80b688c8f04dfa8686e5755d4f2203'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:36.478480 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c80b688c8f04dfa8686e5755d4f2203'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:36.479100 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c80b688c8f04dfa8686e5755d4f2203'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:36.491503 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4b2fd5e0-a46e-4f72-bc07-fa8ca76401a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c80b688c8f04dfa8686e5755d4f2203'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:36.497268 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1454/2911] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:44:36 2022] DELETE /identity/v3/users/6c80b688c8f04dfa8686e5755d4f2203 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:44:36.758215 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ca61-4481-4104-a847-2f9ea42104a6 service swift] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:36.770186 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ca61-4481-4104-a847-2f9ea42104a6 service swift] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:36.831940 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:36.836044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:36.836044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:36.836044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] PATH_INFO: `/v3/projects/77fbe107d1744e1e8da04102881ca0b9` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:36.836044 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77fbe107d1744e1e8da04102881ca0b9)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:36.836861 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:36.952090 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77fbe107d1744e1e8da04102881ca0b9', 'request_id': 'req-23207145-3ffb-43bc-8938-c66823900f73'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:36.958194 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77fbe107d1744e1e8da04102881ca0b9', 'request_id': 'req-23207145-3ffb-43bc-8938-c66823900f73'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:36.964445 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77fbe107d1744e1e8da04102881ca0b9', 'request_id': 'req-23207145-3ffb-43bc-8938-c66823900f73'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:37.042945 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] The token cache is being invalidate because project 77fbe107d1744e1e8da04102881ca0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:44:37.043239 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:37.043857 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-23207145-3ffb-43bc-8938-c66823900f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:37.045395 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1458/2912] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:44:36 2022] DELETE /identity/v3/projects/77fbe107d1744e1e8da04102881ca0b9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:44:37.050360 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c435c47-de39-46ea-a236-4a76d229f78d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:37.053760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c435c47-de39-46ea-a236-4a76d229f78d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:37.053760 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c435c47-de39-46ea-a236-4a76d229f78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:37.070692 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8c435c47-de39-46ea-a236-4a76d229f78d None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:44:37.071947 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8c435c47-de39-46ea-a236-4a76d229f78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:37.130078 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1455/2913] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:44:37.137704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9c3f-1e57-4a96-a0e9-987c4941a0a8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:37.137993 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9c3f-1e57-4a96-a0e9-987c4941a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:37.138272 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9c3f-1e57-4a96-a0e9-987c4941a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:37.158486 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-620e9c3f-1e57-4a96-a0e9-987c4941a0a8 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:44:37.159674 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-620e9c3f-1e57-4a96-a0e9-987c4941a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:37.167776 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1459/2914] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:44:37.171935 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c435c47-de39-46ea-a236-4a76d229f78d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:37.181493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c435c47-de39-46ea-a236-4a76d229f78d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:37.186253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79378a7-4972-4b32-ab5b-cb6e6891d34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:37.186859 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79378a7-4972-4b32-ab5b-cb6e6891d34b admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:37.187136 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79378a7-4972-4b32-ab5b-cb6e6891d34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:37.187411 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79378a7-4972-4b32-ab5b-cb6e6891d34b admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:37.188083 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79378a7-4972-4b32-ab5b-cb6e6891d34b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:44:37.188392 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79378a7-4972-4b32-ab5b-cb6e6891d34b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:37.189984 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79378a7-4972-4b32-ab5b-cb6e6891d34b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:37.202253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1456/2915] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:44:37.211295 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9c3f-1e57-4a96-a0e9-987c4941a0a8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:37.220815 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9c3f-1e57-4a96-a0e9-987c4941a0a8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:37.225817 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52c30c-ebfb-4b9c-9500-1d9c23b3e541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:37.226299 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52c30c-ebfb-4b9c-9500-1d9c23b3e541 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:37.226716 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52c30c-ebfb-4b9c-9500-1d9c23b3e541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:37.227052 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52c30c-ebfb-4b9c-9500-1d9c23b3e541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:37.227785 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52c30c-ebfb-4b9c-9500-1d9c23b3e541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:37.229781 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52c30c-ebfb-4b9c-9500-1d9c23b3e541 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:37.325318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1460/2916] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:44:37 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:44:37.329593 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79378a7-4972-4b32-ab5b-cb6e6891d34b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:37.340235 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79378a7-4972-4b32-ab5b-cb6e6891d34b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:37.387724 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:37.396682 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef08e-df40-4c77-bd66-0b43414f6007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:37.398093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef08e-df40-4c77-bd66-0b43414f6007 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:37.398093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef08e-df40-4c77-bd66-0b43414f6007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:37.398093 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef08e-df40-4c77-bd66-0b43414f6007 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:37.398475 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ef08e-df40-4c77-bd66-0b43414f6007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:37.400449 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ef08e-df40-4c77-bd66-0b43414f6007 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:37.466775 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1457/2917] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:44:37 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:44:37.470823 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52c30c-ebfb-4b9c-9500-1d9c23b3e541 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:37.481205 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52c30c-ebfb-4b9c-9500-1d9c23b3e541 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:37.485908 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79b71-7529-44d9-95a8-0641a472eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:37.486502 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79b71-7529-44d9-95a8-0641a472eb47 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:37.486779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79b71-7529-44d9-95a8-0641a472eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:37.487050 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79b71-7529-44d9-95a8-0641a472eb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:37.487691 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b79b71-7529-44d9-95a8-0641a472eb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:37.489885 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b79b71-7529-44d9-95a8-0641a472eb47 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:37.499702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1461/2918] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:44:37.504661 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef08e-df40-4c77-bd66-0b43414f6007 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:37.514140 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef08e-df40-4c77-bd66-0b43414f6007 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:37.519025 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857347e9-a1c7-4f36-8fdd-b27e7bde4efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:37.519628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857347e9-a1c7-4f36-8fdd-b27e7bde4efc admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:37.519935 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857347e9-a1c7-4f36-8fdd-b27e7bde4efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:37.520213 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857347e9-a1c7-4f36-8fdd-b27e7bde4efc admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:37.520838 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857347e9-a1c7-4f36-8fdd-b27e7bde4efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:37.522463 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857347e9-a1c7-4f36-8fdd-b27e7bde4efc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:37.533192 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1458/2919] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 09:44:37.537166 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79b71-7529-44d9-95a8-0641a472eb47 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:37.546948 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79b71-7529-44d9-95a8-0641a472eb47 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:37.552218 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af984c4a-e7dc-4799-8f6a-1a759fbbe0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:37.552883 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af984c4a-e7dc-4799-8f6a-1a759fbbe0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:37.553160 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af984c4a-e7dc-4799-8f6a-1a759fbbe0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:37.553431 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af984c4a-e7dc-4799-8f6a-1a759fbbe0cb admin admin] PATH_INFO: `/v3/projects/3f1b3ba8a48e4b05b6a867db0727ae1b/users/cc1426beb8844da4a5607c08f8776f58/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:37.569221 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af984c4a-e7dc-4799-8f6a-1a759fbbe0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1b3ba8a48e4b05b6a867db0727ae1b, user_id=cc1426beb8844da4a5607c08f8776f58, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:37.571852 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af984c4a-e7dc-4799-8f6a-1a759fbbe0cb admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:37.666697 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1462/2920] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:44:37 2022] PUT /identity/v3/projects/3f1b3ba8a48e4b05b6a867db0727ae1b/users/cc1426beb8844da4a5607c08f8776f58/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:44:37.677533 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47125b85-15fb-4ec9-afd0-ca10ed292d4f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:37.678367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47125b85-15fb-4ec9-afd0-ca10ed292d4f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:37.678367 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47125b85-15fb-4ec9-afd0-ca10ed292d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:37.706172 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-47125b85-15fb-4ec9-afd0-ca10ed292d4f None None] MFA Rules not processed for user `cc1426beb8844da4a5607c08f8776f58`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:44:37.707395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-47125b85-15fb-4ec9-afd0-ca10ed292d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:37.770340 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1459/2921] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:44:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:44:37.781417 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af984c4a-e7dc-4799-8f6a-1a759fbbe0cb admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:37.783169 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-af984c4a-e7dc-4799-8f6a-1a759fbbe0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:37.798131 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:37.963834 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af984c4a-e7dc-4799-8f6a-1a759fbbe0cb admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:37.967416 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8caf66-e8ff-4414-aa53-d88e2973af9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:37.968051 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8caf66-e8ff-4414-aa53-d88e2973af9a service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:37.968327 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8caf66-e8ff-4414-aa53-d88e2973af9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:37.968597 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8caf66-e8ff-4414-aa53-d88e2973af9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:37.977207 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8caf66-e8ff-4414-aa53-d88e2973af9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:37.978607 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8caf66-e8ff-4414-aa53-d88e2973af9a service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:37.987690 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1463/2922] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:44:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 09:44:40.994111 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47125b85-15fb-4ec9-afd0-ca10ed292d4f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:41.057183 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47125b85-15fb-4ec9-afd0-ca10ed292d4f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:41.061677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:41.062301 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:41.062574 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:41.062841 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] PATH_INFO: `/v3/users/cc1426beb8844da4a5607c08f8776f58` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:41.063981 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1426beb8844da4a5607c08f8776f58)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:41.066243 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:41.300901 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1426beb8844da4a5607c08f8776f58'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:41.385897 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1426beb8844da4a5607c08f8776f58'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:41.393296 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1426beb8844da4a5607c08f8776f58'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:41.393943 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1426beb8844da4a5607c08f8776f58'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:41.395061 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:41.406929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1426beb8844da4a5607c08f8776f58'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:41.413395 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1460/2923] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:44:40 2022] DELETE /identity/v3/users/cc1426beb8844da4a5607c08f8776f58 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:44:41.417915 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3304-52b8-4433-8a0e-f8b34f1b4332 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:41.418375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3304-52b8-4433-8a0e-f8b34f1b4332 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:41.418494 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3304-52b8-4433-8a0e-f8b34f1b4332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:41.436765 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-71cb3304-52b8-4433-8a0e-f8b34f1b4332 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:44:41.437938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-71cb3304-52b8-4433-8a0e-f8b34f1b4332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:41.494188 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1464/2924] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:44:41.503733 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:41.505694 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:41.561628 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79348-59a5-41f7-8dce-ac07b342366e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:41.565112 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b2e07-7168-4625-b306-a926df663d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:41.565708 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b2e07-7168-4625-b306-a926df663d3f service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:41.565979 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b2e07-7168-4625-b306-a926df663d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:41.566244 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b2e07-7168-4625-b306-a926df663d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:41.575436 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b2e07-7168-4625-b306-a926df663d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:41.576885 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b2e07-7168-4625-b306-a926df663d3f service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:41.586664 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1461/2925] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:44:42.022540 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb3304-52b8-4433-8a0e-f8b34f1b4332 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:42.023995 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-71cb3304-52b8-4433-8a0e-f8b34f1b4332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:42.036157 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb3304-52b8-4433-8a0e-f8b34f1b4332 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:42.040798 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:42.041456 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:42.041733 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:42.042018 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] PATH_INFO: `/v3/projects/3f1b3ba8a48e4b05b6a867db0727ae1b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:42.043118 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1b3ba8a48e4b05b6a867db0727ae1b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:42.045069 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:42.147689 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1b3ba8a48e4b05b6a867db0727ae1b', 'request_id': 'req-c9966dbf-78b6-484f-8cc8-c64da18a9c34'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:42.153293 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1b3ba8a48e4b05b6a867db0727ae1b', 'request_id': 'req-c9966dbf-78b6-484f-8cc8-c64da18a9c34'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:42.159696 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1b3ba8a48e4b05b6a867db0727ae1b', 'request_id': 'req-c9966dbf-78b6-484f-8cc8-c64da18a9c34'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:42.237492 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] The token cache is being invalidate because project 3f1b3ba8a48e4b05b6a867db0727ae1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:44:42.237779 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:42.238413 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-c9966dbf-78b6-484f-8cc8-c64da18a9c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:42.239986 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1465/2926] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:44:42 2022] DELETE /identity/v3/projects/3f1b3ba8a48e4b05b6a867db0727ae1b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:44:42.244791 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724580f-ce7e-4fda-aafa-f9a5aa8aec91 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:42.245269 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724580f-ce7e-4fda-aafa-f9a5aa8aec91 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:42.245376 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724580f-ce7e-4fda-aafa-f9a5aa8aec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:42.264931 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d724580f-ce7e-4fda-aafa-f9a5aa8aec91 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:44:42.266122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d724580f-ce7e-4fda-aafa-f9a5aa8aec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:42.326433 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1462/2927] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:44:42.335308 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e89cb2-dd86-49c8-9220-0edc14ca3f43 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:42.335590 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e89cb2-dd86-49c8-9220-0edc14ca3f43 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:42.335865 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e89cb2-dd86-49c8-9220-0edc14ca3f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:42.355374 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-04e89cb2-dd86-49c8-9220-0edc14ca3f43 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:44:42.356638 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-04e89cb2-dd86-49c8-9220-0edc14ca3f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:42.365642 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1466/2928] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:44:42.371305 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724580f-ce7e-4fda-aafa-f9a5aa8aec91 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:42.381614 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724580f-ce7e-4fda-aafa-f9a5aa8aec91 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:42.386292 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdda752-5450-4411-a729-e4a4bc9c3e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:42.386891 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdda752-5450-4411-a729-e4a4bc9c3e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:42.387171 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdda752-5450-4411-a729-e4a4bc9c3e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:42.387445 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdda752-5450-4411-a729-e4a4bc9c3e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:42.388119 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdda752-5450-4411-a729-e4a4bc9c3e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 09:44:42.388443 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdda752-5450-4411-a729-e4a4bc9c3e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:42.390072 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdda752-5450-4411-a729-e4a4bc9c3e1f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:42.402904 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1463/2929] 10.222.0.55 () {58 vars in 1153 bytes} [Fri Sep 2 09:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 09:44:42.406285 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e89cb2-dd86-49c8-9220-0edc14ca3f43 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:42.415509 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e89cb2-dd86-49c8-9220-0edc14ca3f43 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:42.420203 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75cc1e-3c7f-4180-b057-5b4b6cd4eb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:42.420832 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75cc1e-3c7f-4180-b057-5b4b6cd4eb7f admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:42.421047 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75cc1e-3c7f-4180-b057-5b4b6cd4eb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:42.421318 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75cc1e-3c7f-4180-b057-5b4b6cd4eb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:42.421938 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75cc1e-3c7f-4180-b057-5b4b6cd4eb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:42.423867 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75cc1e-3c7f-4180-b057-5b4b6cd4eb7f admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:42.501624 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1467/2930] 10.222.0.55 () {60 vars in 1153 bytes} [Fri Sep 2 09:44:42 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:44:42.506557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdda752-5450-4411-a729-e4a4bc9c3e1f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:42.516437 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdda752-5450-4411-a729-e4a4bc9c3e1f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:42.570974 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030edac5-6ece-45e7-bd90-ee8150c3a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:42.571567 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030edac5-6ece-45e7-bd90-ee8150c3a4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:42.571839 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030edac5-6ece-45e7-bd90-ee8150c3a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:42.572143 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030edac5-6ece-45e7-bd90-ee8150c3a4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:42.572757 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030edac5-6ece-45e7-bd90-ee8150c3a4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:42.574651 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030edac5-6ece-45e7-bd90-ee8150c3a4c8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:42.638435 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:42.643520 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1464/2931] 10.222.0.55 () {60 vars in 1144 bytes} [Fri Sep 2 09:44:42 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 09:44:42.647580 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75cc1e-3c7f-4180-b057-5b4b6cd4eb7f admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:42.658152 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75cc1e-3c7f-4180-b057-5b4b6cd4eb7f admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:42.663393 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9c481-8cbe-47e3-964f-df35041bf584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:42.666237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c481-8cbe-47e3-964f-df35041bf584 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:42.666237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c481-8cbe-47e3-964f-df35041bf584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:42.666237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c481-8cbe-47e3-964f-df35041bf584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:42.666237 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9c481-8cbe-47e3-964f-df35041bf584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:42.666844 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9c481-8cbe-47e3-964f-df35041bf584 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:42.672103 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:42.677533 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1468/2932] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:44:42.681261 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030edac5-6ece-45e7-bd90-ee8150c3a4c8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:42.691060 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030edac5-6ece-45e7-bd90-ee8150c3a4c8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:42.695738 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10570ad-1288-4337-b195-9cb9a37e37cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:42.696359 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10570ad-1288-4337-b195-9cb9a37e37cf admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:42.696645 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10570ad-1288-4337-b195-9cb9a37e37cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:42.696913 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10570ad-1288-4337-b195-9cb9a37e37cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:42.697546 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10570ad-1288-4337-b195-9cb9a37e37cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:42.699121 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10570ad-1288-4337-b195-9cb9a37e37cf admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:42.709715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1465/2933] 10.222.0.55 () {58 vars in 1122 bytes} [Fri Sep 2 09:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 09:44:42.713702 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9c481-8cbe-47e3-964f-df35041bf584 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:42.723807 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9c481-8cbe-47e3-964f-df35041bf584 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:42.728369 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8005-710f-4178-a3a7-0eec519a7157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:42.729002 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8005-710f-4178-a3a7-0eec519a7157 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:42.729273 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8005-710f-4178-a3a7-0eec519a7157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:42.729598 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8005-710f-4178-a3a7-0eec519a7157 admin admin] PATH_INFO: `/v3/projects/d4ff2c9455994a3aa3283d611bacc2ae/users/70545ee5b46648b69eb4dae16d24ca73/roles/8941b3ff5a124d0a918ea79de7649945` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:42.744772 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb8005-710f-4178-a3a7-0eec519a7157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ff2c9455994a3aa3283d611bacc2ae, user_id=70545ee5b46648b69eb4dae16d24ca73, role_id=8941b3ff5a124d0a918ea79de7649945)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:42.747404 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb8005-710f-4178-a3a7-0eec519a7157 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:42.840217 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1469/2934] 10.222.0.55 () {60 vars in 1483 bytes} [Fri Sep 2 09:44:42 2022] PUT /identity/v3/projects/d4ff2c9455994a3aa3283d611bacc2ae/users/70545ee5b46648b69eb4dae16d24ca73/roles/8941b3ff5a124d0a918ea79de7649945 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 09:44:42.841967 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa62996-ed17-4007-b49f-828772f8bf55 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:42.842253 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa62996-ed17-4007-b49f-828772f8bf55 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:42.842530 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa62996-ed17-4007-b49f-828772f8bf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:42.872207 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2fa62996-ed17-4007-b49f-828772f8bf55 None None] MFA Rules not processed for user `70545ee5b46648b69eb4dae16d24ca73`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:44:42.873420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2fa62996-ed17-4007-b49f-828772f8bf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:42.938492 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1466/2935] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:44:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:44:42.949375 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8005-710f-4178-a3a7-0eec519a7157 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:42.951087 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4ffb8005-710f-4178-a3a7-0eec519a7157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:43.008335 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8005-710f-4178-a3a7-0eec519a7157 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:43.011937 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23290e9e-34d2-48a6-9d6a-dc1caf512e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b6abdeca334777b597215dfe157688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:43.012582 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23290e9e-34d2-48a6-9d6a-dc1caf512e61 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:43.012858 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23290e9e-34d2-48a6-9d6a-dc1caf512e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:43.013129 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23290e9e-34d2-48a6-9d6a-dc1caf512e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:43.022942 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23290e9e-34d2-48a6-9d6a-dc1caf512e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:43.024496 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23290e9e-34d2-48a6-9d6a-dc1caf512e61 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:43.034130 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1470/2936] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:44:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:44:43.060114 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa62996-ed17-4007-b49f-828772f8bf55 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:43.122825 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa62996-ed17-4007-b49f-828772f8bf55 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:43.127592 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:43.128276 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:43.128557 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:43.128835 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] PATH_INFO: `/v3/users/70545ee5b46648b69eb4dae16d24ca73` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:43.130059 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70545ee5b46648b69eb4dae16d24ca73)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:43.132052 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:43.367036 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70545ee5b46648b69eb4dae16d24ca73'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:43.437878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70545ee5b46648b69eb4dae16d24ca73'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:43.445854 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70545ee5b46648b69eb4dae16d24ca73'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:43.446493 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70545ee5b46648b69eb4dae16d24ca73'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:43.458889 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70545ee5b46648b69eb4dae16d24ca73'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:43.460391 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:43.465579 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1467/2937] 10.222.0.55 () {58 vars in 1224 bytes} [Fri Sep 2 09:44:43 2022] DELETE /identity/v3/users/70545ee5b46648b69eb4dae16d24ca73 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:44:43.470106 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dd9da-fc9e-42cf-a9d8-64c79dff7338 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:43.470651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dd9da-fc9e-42cf-a9d8-64c79dff7338 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:43.470651 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dd9da-fc9e-42cf-a9d8-64c79dff7338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:43.488994 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-301dd9da-fc9e-42cf-a9d8-64c79dff7338 None None] MFA Rules not processed for user `5721b6199cb646449381111a06a1e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 09:44:43.490163 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-301dd9da-fc9e-42cf-a9d8-64c79dff7338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:43.549558 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1471/2938] 10.222.0.55 () {58 vars in 958 bytes} [Fri Sep 2 09:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 09:44:43.559094 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:43.560677 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:43.617878 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156eec35-3f9e-40f4-bdec-58e03ef35d55 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:43.621540 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a764d8-61bb-4809-bfa0-4a1878303bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bb83de9f794ac9b02e5dca2df3e4d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:43.622142 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a764d8-61bb-4809-bfa0-4a1878303bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:43.622420 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a764d8-61bb-4809-bfa0-4a1878303bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:43.622690 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a764d8-61bb-4809-bfa0-4a1878303bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:43.632947 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a764d8-61bb-4809-bfa0-4a1878303bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:43.634385 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a764d8-61bb-4809-bfa0-4a1878303bd3 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:43.644375 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1468/2939] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:44:44.045510 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dd9da-fc9e-42cf-a9d8-64c79dff7338 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:44:44.046301 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-301dd9da-fc9e-42cf-a9d8-64c79dff7338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:44:44.058837 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dd9da-fc9e-42cf-a9d8-64c79dff7338 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:44:44.063544 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5721b6199cb646449381111a06a1e879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736e52eb4dfe4b01a672224315f6274a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:44:44.064209 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:44:44.064490 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:44:44.064769 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] PATH_INFO: `/v3/projects/d4ff2c9455994a3aa3283d611bacc2ae` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:44:44.065889 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ff2c9455994a3aa3283d611bacc2ae)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:44:44.068498 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:44:44.173500 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ff2c9455994a3aa3283d611bacc2ae', 'request_id': 'req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:44.179704 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ff2c9455994a3aa3283d611bacc2ae', 'request_id': 'req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:44.185801 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ff2c9455994a3aa3283d611bacc2ae', 'request_id': 'req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:44.247322 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] The token cache is being invalidate because project d4ff2c9455994a3aa3283d611bacc2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 09:44:44.247608 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:44.248248 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-5d18a040-9dd4-4828-bffd-5e7bb73e79a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 09:44:44.249728 dv-cinder-850831-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1472/2940] 10.222.0.55 () {58 vars in 1233 bytes} [Fri Sep 2 09:44:44 2022] DELETE /identity/v3/projects/d4ff2c9455994a3aa3283d611bacc2ae => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 09:44:53.639715 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=27 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:54.244083 dv-cinder-850831-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:45:40.164879 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a764d8-61bb-4809-bfa0-4a1878303bd3 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 09:45:40.166278 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-85a764d8-61bb-4809-bfa0-4a1878303bd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:45:40.234763 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a764d8-61bb-4809-bfa0-4a1878303bd3 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 09:45:40.293080 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891996f-bb49-4d17-86ab-008876c763a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1d19d1439914eac9993bf31fa4c9384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b917be6587a5413bae8786a9c2e5a9df', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 09:45:40.293647 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891996f-bb49-4d17-86ab-008876c763a9 service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 09:45:40.293929 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891996f-bb49-4d17-86ab-008876c763a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 09:45:40.294319 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891996f-bb49-4d17-86ab-008876c763a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 09:45:40.296122 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e891996f-bb49-4d17-86ab-008876c763a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 09:45:40.307265 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891996f-bb49-4d17-86ab-008876c763a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 09:45:40.308870 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891996f-bb49-4d17-86ab-008876c763a9 service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 09:45:40.319090 dv-cinder-850831-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1469/2941] 10.222.0.55 () {60 vars in 1365 bytes} [Fri Sep 2 09:45:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 09:45:50.314381 dv-cinder-850831-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=58 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}